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ABSTRACT 



An interpretive language comprises instructions making 
up part of the first sequence of instructions (a test 
"script"). The first language comprises a first set of 
instructions, the first set of instructions causes a first 
computer system (a "host" in a preferred embodiment) 
to issue a series of commands to a second computer 
system (a "target") in order to cause the second com- 
puter system to emulate user activity on the second 
computer system. User activity includes emulating typ- 
ing text and/or moving a mouse cursor position. The 
language further comprises a second set of instructions 
which cause the first computer system to issue a series 
. of commands to the second computer system in order to 
cause the second computer system to respond to the 
first computer system with its state. This state includes 
user interface objects, and applications running in the 
target, etc. The language further comprises a third set of 
instructions, the third set of instructions causing the first 
computer system to issue a sequence of commands to 
the second computer system to respond in a predefined 
manner. These instructions indicate that the target com- 
puter system is to respond in within a given period of 
time, listen for further commands, etc. This is useful for 
repeatable and systematic testing of computer systems 
having a variety of hardware and software combina- 
tions for compatibility testing. Multitasking using 
"threads" for control of different targets using different 
test routines is also provided. 

18 Claims, 11 Drawing Sheets 
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y ^ ra tests must be performed flawlessly in order for the test- 

INTERPRETER FOR PERFORMING REMOTE ing process to be performed effectively. In addition, the 
TESTING OF COMPUTER SYSTEMS user must view the tested system's display and/or other 

results to determine if the user action achieved the de- 
This is a continuation of application Ser. No. 5 sired result. Again, to ensure proper functioning, this 
07/795,913, filed Nov. 20, 1991, now abandoned. must be done repetitively. Human beings typically can- 

BACKGROUND OF THE INVENTION n0t P erfonn repetitive tasks such as these in an effective 

manner and monitor all the actions on the tested com- 

1. Field of the Invention puter system perfectly. Also, testing of new computer 
This invention relates to performing diagnostics on 10 systems requires repetitive and repeatable testing. This 

computer systems. More specifically, this application is to ensure that errors ("bugs") or other unexpected 
relates to remotely testing computer systems having a results are reproducible so that the source of the error 
variety of hardware/software combinations. can be determined. Therefore, repeatable testing on 

2. Background of Related Art various hardware/software platforms is required. These 
Traditional testing of computer systems and their 15 tests should also have a minimum impact on the system 

associated software and firmware typically require that being tested so as to minimis the effect of the testing 
manual tests be designed in order to make sure that each process (called "corruption") on the computer being 
function on given programs is operating as expected. In tested. These tests should also have a means for record- 
addition, such testing must be performed on a variety of ing the results of the tests so that they may be examined 
systems running different hardware/software combina- 20 to analyze the error. 

tions to determine the compatibility of the underlying In summary, substantial delays and errors are caused 
system- These tests require substantial user intervention in the testing of computer systems prior to shipping, 
because certain operations on these computer systems Also, the testing process may fail to catch all errors in a 
must be performed manually. Also, the results of those particular hardware/software combination. 

operations must be monitored by looking at files, the 25 

display of the system, or other results of performing the SUMMARY AND OBJECTS OF THE 

operations to determine if the proper result has been , INVENTION 
accomplished. This is a time-consuming and tedious One of the objects of the present invention is to pro- 
process. Sometimes this takes the form of releasing a vide an automated means for testing a wide variety of 
pre-release version of the system, a so-called **beta re- 30 computer systems in a standardized way. 
lease." This type of release of a product is one which is Another of the objects of the present invention is to 
distributed to a limited number of individuals, typically provide a means for testing computer systems in a rela- 
very experienced computer program developers, and- tively systematic and error-free environment, 
/or system programmers, to determine if there are any Another of the objects of the present invention is to 
remaining errors or other unexpected results in the 35 provide a means for testing a computer system repeti- 
underlying system or system software. tively such that any errors in a variety of computer 

Both the initial testing process and the beta testing hardware/software combinations may be reproduced 
process, discussed above, are time-consuming and te- and thus more easily eliminated, 
dious tasks for individuals testing the computer system. Another of the objects of the present invention is to 
They are also expensive for a manufacturer. Such test- 40 provide a cost effective means to test a wide variety of 
ing requires that the system be tested on a wide variety computer software/hardware combinations, 
of compatible platforms (for instance, in the Macintosh Another of the objects of the present invention is to 
brand family of computers, the Macintosh SE brand provide a means for remotely testing at least one corn- 
computer system, the Macintosh II, and other systems puter.system to nummize the interference (the corrup- 
using a variety of hardware platforms but having com- 45 tion) of the computer system by the apparatus perform- 
patible operating system software). For instance, an ing the test. 

error which might occur in one model of machine or in Another object of the present invention is to provide 
one type of software combination may not occur on a means for remotely testing a plurality of computer 
another machine having a different hardware and/or systems by emulating user manipulation of user inter- 
software combination. Testing each hardware platform 50 face objects on the systems and monitoring the results 
in combination with certain underlying software re- of the manipulation remotely. 

quires careful testing for proper compatibihty. Another of the objects of the present invention is to 

In addition to a variety of manual tests required for provide a means for remotely monitoring the user inter- 
ensuring the functioning of a computer system, because face and operating system of a computer system, 
the tests are performed manually they may become very 55 These and other objects of the present invention are 
time-consuming and tedious. The testing process may provided for by a system for interpreting a first se- 
also become error-prone, depending on the individuals quence of instructions. A first language comprises in- 
performing the testing of systems. To ensure that a structions making up part of the first sequence of in- 
computer software product is fully functional before structions (a test "script"). The first set of instructions 
shipping a released product, the so-called "beta release" 60 of the language causes a first computer system (a "host" 
process takes a certain period of time. A long delay in in a preferred embodiment) to issue a series of corn- 
testing a final version of a computer system, including mands to a second computer system (a 'target") in 
specific hardware and software combinations, may order to cause the second computer system to emulate 
delay the release of a product so much that competitive user activity on said second computer system. User 
advantage may be lost. 65 activity includes emulating typing text and/or moving a 

Some prior art systems used for testing also require mouse cursor position. The language further comprises 
that the user input a series of commands and/or user a second set of instructions. The second set of instruc- 
activity which will generate an expected result. These tions causes the first computer system to issue a series of 
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commands to the second computer system in order to nT>T ™ i-ycc oi> toxt^xt ™? tm> a wTxrnc 
cause the second computer system to respond to the BRIEF DESCRIPTION OF DRAWINGS 
first computer system with the state of the display of the The present invention is illustrated by way of exam- 
second computer system. This includes user interface P* e not limitation of the of the accompanying in 
objects, and applications running in the target, etc. The 3 ^*|ch like references indicate like elements and in 
language further comprises a third set of instructions, which: 

the third set of instructions causing the first computer . Fia 1 shows coupling of computer systems used 

system to issue a sequence of commands to the second m the preferred embodiment. 

computer system to respond in a predefined manner. e FIG * 2 ^ ov/s a m 5? u scre ™ for initiating a test script 

These instructions indicate that the target computer 10 fron ?. the host machme to te P^ 0 ™* 1 on a **g* 
. , . ... . . , „ . machine. 

system is to respond in within a given penod of time, , , . - , . _^ , 

* -U • . *t*i_ * • - . FIG. 3 shows some user interface objects which may 

listen for further commands, etc. The preferred embodi- . r . , ^ . . „. i „ 

. A , r „ * »«^iww»«»Muiuu be referred to and mampulated by the host macrune on 

ment therefore allows a user to generate a test "script" a target machine 

or command language program which defines a series l5 Fia 4 shows "the structure of a "pull-down" menu 
of testswhich may be performed on the target com- which may be referenced and manipulated on a target 
puter. This is useful for repeatable and systematic test- machine by a host machine. 

ing of computer systems having a variety of hardware FIGS. 5 and 6 show additional menu items which 
and software combinations for compatibility testing. may be referenced and manipulated in a target machine 
Faults in the system(s) may be isolated, thus allowing 20 by a host machine. 

corrective measures to be taken. This is a distinct im- FIG. 7 shows two windows which may be examined 
provement over prior art manual testing by individual for matching user interface traits, 
testers. FIG. 8 shows a flow diagram of a host machine pro- 

These and other objects of the present invention are cess used to update a cursor position in a target ma- 
provided for by an interpretive language capable of 25 chine. 

being interpreted by a first computer system (a "host") FIG. 9 shows a flow diagram of a host machine pro- 
to cause a second computer system to perform specified ^ used to resize a window in a target machine, 
actions. The language includes a first set of descriptors FIG - 10 ^ ows "> example of resizing a window in a 

which define abstractions of user interface objects on target machme. 

the second computer system (the "target") and a first set 30 ™° 11 a commuiucation scheme utilized by 

of commands which direct emulated user actions to be the ***** machme for commumcatm S ^ host 
performed on the user interface objects in the second DETAILED DESCRIPTION 

of m P^^ A portion of the disclosure of this patent document 

of commands which request mformation regarding the 35 CQntains which h subject to ^ ^ ht otec . 

user interface objects in the second computer system. tion . ^ c^ght owner has no objection* the fac- 

The mformation is in the form of abstractions of the user smlile reproduction by anyone of the patent disclosure, 

interface objects and avoids transmitting bitmap images as it appears in the Patent and Trademark Office patent 

of the target computer system to the host computer files or records, but otherwise reserves all copyright 
system so that the abstractions may be checked against 40 rights whatsoever. Copyright Apple Computer, Inc. 

expected results. Therefore, repeatable and systematic The present invention covers a method and apparatus 

testing of computer systems may be accomplished. for remotely testing and monitoring computer systems. 

These and other objects of the present invention are In the following description, for the purposes of expla- 
further provided for a system for testing computer sys- nation, specific data structures, information, packets,, 
terns which comprises a first target computer system 45 protocols, user interface objects, and other details used 
having a first hardware/software combination and a by the preferred embodiment are set forth in order to 
second target computer system having a second hard- provide a thorough understanding of the present inven- 
ware/software combination. A host computer system **on. It will be appreciated, however, by one skilled in 
comprises means for directing a first thread to control ^ e 814 that the present invention may be practiced 
the actions of the first target computer system using a 50 without these specific details. In other instances, well- 
first sequence of instructions and a second thread to known circuits and devices are shown in block diagram 
control the actions of the second target computer sys- f orm m order t0 not unnecessarily obscure the present 
tem using a second sequence of instructions indepen- invention. 

dent of the first target computer system. Thus, multiple Coupling of the Preferred Embodiment— FIG. 1 

computers having different hardware/software combi- r , ... 

nations may be tested using different test script routines ™ e pre ff* e <L embodiment is a testing environment 

„ p - j;rru' ♦ 7 iU . , m . K . wherein a host computer system issues commands to 

using differen^rocesses ( -threads") in the host com- „ ter s *g £ e taf t uter 

puter system. The first and second sequences of ins true- * 6 i. w«i F ui» 3jr»«*i», ««; «"6» wmipuic* »yj»- 

♦L« tl^ — « ■ ♦ »\ i * ^ 17." terns returning the results of those operations back to 

uons (the test scripts' ) emulate user activity on the ^ ^ host ^ y of ^ sys[cn £ m ^ prcfcrred 

first and second target computer systems and cause the embodiment is graphically represented with reference 

first and second computer systems to report the state.of to Fia L For instance, on a network such as 110 

user interface objects on displays coupled to the first sn0 wn in FIG. 1, a host 100 may be coupled to the 

and second computer systems. Therefore, the results of network for communication with various target ma- 
emulated user activity may be tested for. A means for 65 chines such as 121 through 125. The host computer 

communicating, such as a local area network, couples system 100 communicates with each of target machines 

the host computer system to the first and second target 121 through 125 over network 110 for instructing the 

computer systems. targets to perform various tasks. Each of the target 
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machines 121 through 125 can communicate over net- trolled by the script associated with the actor and the 

work 110 for providing results of those tasks back to director. 

host 100 when host 100 initiates a communication. In a Because each of the target machines 121 through 125 
preferred embodiment, host 100 and target machines may be different models of the same computer system 
121 through 125 are members of the Macintosh brand 5 with different hardware and/or software configura- 
family of personal computers manufactured by Apple tions, h is possible to test computer software on each of 
Computer, Inc. of Cupertino, Calif. In a preferred em- the systems using the same set of tests, but in different 
bodiment, network 110 is the Appletalk brand local area hardware/software environments. Therefore, compati- 
network (LAN). It will be appreciated by one skilled in bility testing of the program with various configura- 
the art, however, that any type of machine which has a 10 tions of hardware and software may be performed. In 
network capability may communicate with other ma- addition, the preferred embodiment provides for rigor- 
chines in a network such as 110 in a similar manner. ous repetitive testing of each of the target machines 
Network 110 may be one of the other types of LAN's usm S the scripts for each of the actors. Therefore, faults 
commercially available in the market, such as Ethernet, *>e detected from multiple iterations of a script, 
a token ring, or a star LAN system in alternative em- 15 wnerc *n a manual testing of individual machines may 
bodiments. not otherwise uncover such flaws. 

The preferred embodiment is a system in which tasks Th e system of the preferred embodiment comprises 

are described in a high level script or command Ian- two ma J or components: the host system, and the target 

guage interpreted and executed by host machine 100. system(s). The host system provides all the "acting" and 

On the basis of the commands written in this script 20 " directill g" functions as described above. The host in- 

language, host machine 100 directs target machines 121 ter P rets the scripts and issues commands to the target 

through 125 to perform certain actions and respond to machines to perform emulated user operations based on 

the host with the results of those actions. Communica- Aho * host <l ueries *> determine 

tion is provided in a manner well-known to those skilled ? e s * te of ±e ^et machines and receives messages 

in the art, between host 100 and targets 121 through 125 25 ?° m machines responding with the requested 

using Appletalk brand network protocols (for instance, ™«™*k»- manner ' J*™* ^ ^ * 

the Appletalk Transaction Protocol or ATP) such as fimJated on the target machines and the results exam- 

those referred to in the publication "Inside Appletalk, ^ by *** host for k^-The target machines receive 

Second Edition" by Gursharan E. Sidhu, Richard F. 7n ? e ™ gCS transmittcd b Y P^™ the 

Andrews, and Alan B. Oppenheimer (1990) available 30 n^T* ^Z^^ ^^^^^ 

from Addison-Wesley PubfchTg Company, Inc. (here- sample cer^ data structocs witmn the torget machine 

inafter "Inside Appletalk"). The majority of the under- T S *° ^ ^ to wh ? hcr 

K • t . , „ J y !Z ZZ n given operations were successful or not These func- 

C~nt^ ™1 T?7S? J* ^ ?° St tions wulbe discussed in more detail below. The pro- 

™ d *£f J^^^ 8™ ™S on the target machine, known as an 

» wntten m the C++ programming language and « t „ h ioMkd on ^^gtt machine in a prede- 

ESff Z & a ! ^ C++ compilation tools ^ (the ^ Sy3tcm F S, der » m the MacLosh 

r^ vJ PP - C ? mP ^ r ^ In «n 0f n CUpe^tI ?^ ), brand operating system) so that it will be recognized 
Calif. Portions are implemented m 680 x 0 assembly ^ loaded durmg ^ up initiation of the^rget 
anguage. It. san be appreciated ; by one skilled m the art ^ ^ ^ ^ Macintosh brand operating environ- 

^p^ y A°M C p T ° ^ gh CVe ^ nB ° EB * SU °? 88 ment > the agent program is loaded into the central pro- 
FORTRAN, Pascal, or low level language such as cessing unit as an initialization routine known as an 
assembly language, may be used to implement the sys- "INIT" or "system extension." In alternative embodi. 
tern in alternative embodiments. ments on IBM PC brand compatible computer systems, 

The architecture of the preferred embodiment is 45 such a routine may be loaded as a 'TSR" ("teniunate 
based on a theater metaphor. Each individual test which and stay resident") program which resides in the mem- 
is wntten for target machmes such as 121 through 125 ory of the target system and performs given actions as 
shown in FIG. 1 is executed by "actors" or subtasks in directed by the host, 
the host. Each of the actors plays different roles, per- 
forming different tests by interpreting and executing 50 Command Line Invocation 
actions indicated by different "scripts" (command lan- The host machine operates in two modes for initiating 
guage routines) for target machines coupled to network execution of scripts via actors onto target machines: a 
110. There is also a "director" in the system of the command line mode; or an interactive window interface 
preferred embodiment which stages, oversees, and di- controlled mode. The command line scheme may be 
rects the test execution of each of the actors. An actor 55 used to launch actors in the preferred embodiment using 
may be any entity that plays a role in a testing process. a command line such as: 
The most common types of actors which are used in the vu-a "Actorl"-t "*:TargetMac"-s Script.vu 
preferred embodiment are those which emulate user which starts the actor thread "Actorl" in the host to 
action in the target system. Other actors which are control the target machine "TargetMac" using the 
contemplated within the spirit and scope of the pre- 60 script "Script. vu." Each of the parameters in the above 
ferred embodiment are those which include a human example command line are defined as follows. The "-a" 
tester entering commands on the keyboard directly on option specifies the name of the actor. This name is an 
each of the target machines, or any external functions . alphanumeric string. From that point on, the test run- 
which can communicate with the director or the actors ning on the target machine may be referred to by this 
running the tests. Each of the actors runs as an indepen- 65 string. So, in the example given above, the test running 
dent task in a multitasking mode along with the direc- on the target machine may be referred to as the process 
tor. Actors in the system of the preferred embodiment "Actorl." This may be used for checking the results of 
are different processes or "threads" which are con- given tests, or performing single line commands. The 
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"-t" option indicates the target address of the target 
machine. In this case; the target is "*:TargetMac." The 
target name is specified in the following format: 
"<zone>: <target user name>." The as used in 
the Appletalk brand networking system, is the current 
zone that the host machine resides in. Further, the tar- 
get user name, in this case, "TargetMac" is the second 
field. The specification of named entities in networks 
such as zones and user names are discussed in more 
detail in the publication "Inside Appletalk," at pages 7-1 
to 8-24. It will be appreciated by one skilled in the art 
that other types of networking systems may be used in 
alternative embodiments which use unique network 
addresses or names for target machines. In an alterna- 
tive embodiment, the network path name may be re- 
placed with the Internet address of the target machine. 
This address will be of the form " <network number > : 
<note I.D.>: <socket number>." 

The M -s" option, as shown on the command line 
above, is used for indicating the name of the script (or 20 
command) file to be executed on the target machine by 
the actor. Script files contain a sequence of instructions 
which cause actions to occur on the target machine for 
either causing specific user actions to be emulated, 
checking the state of the target machine, or performing 25 
other functions such as modifying variables within the 
script file (for example, error counts) for performance 
of the test Script files will be discussed in more detail 
below. 

Other options which may be specified on the "vu" 30 
command line include the following: 

-c: This option indicates compile only. It is used for 
checking the syntax of the script file without exe- 
cuting it Error messages are reported to the user of 
the host using the standard output file (for instance, 35 
the display). Using this option does not require the 
user to specify a target machine, 

-I <log file name>: This is used for specifying the 
name of a log file. Any output messages from the 
script file which would normally go to the standard 40 
output file of the host (such as the display) or error 
warning messages will be placed into the file enti- 
tled <log file name> on the host. 

-dt: This option indicates that a diagnostic trace is to 
be performed when executing the script file. This 45 
option may only be used when a log file has been 
specified using the -1 option discussed above. Any 
errors or other warning messages will be placed 
into the file specified by the -1 option. 

-o <output file name>: This option is used to redi- 30 
rect the output of print or display statements from 
the standard output file (typically the display) to a 
specified file. This may be used for redirecting the 
output of individual actors to specified files. There- 
fore, separate files may be maintained as outputs for 35 
separate actors. 

-m < mouse speed >: This option is used to specify 
the speed of a mouse movement on the target ma- 
chine. A mouse moves in predefined time intervals 
known as steps. < mouse speed > specifies the 60 
number of pixels that the mouse will move in each 
step on the target machine. If all mouse movements 
are desired by the user to be moved in one.step, the 
speed should be set to zero. The default setting for 
the speed is 50. 63 

-k <key stroke.rate>: This option is used to set the 
m axi m um rate of keystrokes on the target machine 
in characters per second. The default setting is 20. 
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-p < patience setting >: This option is used to set the 
overall execution speed of the actor (and therefore 
commands) on the target machine. Actions get 
slower as patience increases. The default setting for 
patience is one. 
-fail <n> : This command is used to specify the maxi- 
mum number of command failures that are to be 
allowed in the course of script execution. If the 
number of failures exceeds <n>, script execution 
will abort. The default setting is infinite, so script 
execution will not stop until the script has been 
completed or the user aborts execution, 
-timeout <t>: This option is used to set the maxi- 
mum time to wait for a transaction with a target 
machine to complete. If the transaction fails to 
complete within <t>, then the transaction is con- 
sidered to have failed. The default setting is 20. The 
maximum value is 255. 
-retries < r> : This sets the maximum number of times 
the actor retries a transaction with the target ma- 
chine. The default setting is 3. The maximum num- 
ber is 255. If 255 is given, in the preferred embodi- 
ment, the number of retries will be considered to be 
infinite. When this occurs, the actor will keep try- 
ing to reaquire the target, 
-cs: This makes the actors string matching case sensi- 
tive. The default for this setting , is that string 
matching is not case sensitive. For instance, in 
default operating mode, "USER" and "user" 
would be considered the same entity by an actor, 
but would not be the same when the "-cs" option is 
used. 

-libs <search path > : This is used to specify the path 
or the directories in which the host is to access task 
libraries. The system of the preferred embodiment 
looks for declared libraries in the current directory 
from which the program is operating. If not found, 
the search path specified by this command is used. 
Each of the options mentioned above may be speci- 
fied with a number suffix to indicate which actor the 
commands apply to. If a command is specified without 
a number suffix, then that command applies to all the 
actors currently running. For instance, if a script is run 
with a "-s" option, then that script will be run on all the . 
actors currently defined. With the exception of the "-t," 
and "-o" options, any command given without a 
number is applied to all actors currently specified. For 
example, three actors may be initiated using the follow- 
ing script commands: 



-ol "Admin? 3 

•tl "•rgozer" a 

-si "AdminTesLvu" 3 

•ol "AdminTesLout" a 

-a2 "Bus/Tester a 

•U "•:chuck" i 

-s2 w BusyWorkstaUon.vu" a 

-o2 M Bu$yWS.out" d 

•m2 1 a 

-k2 30 a 

-a3 M Lazy-Testing" a 

-13 M Fareidc:Twiddlcdec" a 
•43 ' "Lazy Workstation" a 

-03 "LazyWS.our d 

-m3 1 a 

-k3 5 
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In this example, each of the commands with a number must, in some cases, indicate specific information for 
suffix is applied to the actor with that number. For that option by typing in information using the keyboard 
instance, all the commands with the "1" suffix are ap- or accessing another window. For instance, field 201 of 
plied to the actor "Admin," those with "2" are applied. window 200 will contain the name of the target ma- 
to "BusyTester," and those with a "3" are applied to 5 chine. As discussed with reference to the u -t" option in 
"Lazy Tester." the command line above, the name is in the form of 

There are three actors in this example, each running <zone>:<user name>, however, if the target ma- 
different scripts. Actor 1 "Admin" is running the test chine is in the same network zone as the host machine, 
"AdminTestvu," its output is redirected to "Admin then only the <user name> needs be entered into this 
Testout," and its target machine is the unit named 10 field. The target machine in the instance shown in FIG. 
"gozer " This target's mouse and keyboard settings 2, as indicated in field 201, is "TargetMac." 
have been set to the defaults. Actor 2 "BusyTester" is Other options are provided by the "dialog" buttons 
naming on the unit named "chuck" and is running the 202 through 205. Each of these buttons, when selected, 
test script "BusyWorkstation.vu" with the standard will prompt the user for additional information using 
output redefined to "BusyWS.out" The mouse speed 15 other windows. For instance, "Script file" button 202 
and the keyboard speeds have been redefined to very will be selected by the user for indicating the script file 
high values (1 and 50, respectively) emulating a user to be run on the target machine. This performs the same 
who is operating at a higher rate than the default. Actor function as the "-s" option specified in the command 
number 3 "LazyTester" is running in the zone "Far- line interface above. The selection of this button will 
side" on the unit -Twiddledee." LazyTester is rurming 20 cause a standard file dialog box to be displayed allowing 
the script "LazyWorkstation.vu," has its standard out- the user to select the location of the script file to be 
put redefined as "LazyWS.out," and has its mouse and executed on the target machine. The file dialog box is 
keyboard values set to a very low value emulating a well-known to those familiar with the the interactive 
user who is operating at a low rate. windowing interface of the preferred embodiment. 

As mentioned above, the use of a command without a 25 The other **buttons" 203 through 205 have similar 
number suffix indicates that the command should be run functions to their command line counterparts. The "Li- 
on all of the targets currently defined. This is shown in braries Path" option 203 essentially has the same effect 
the following example: as the "-libs" option. The "Output file" button 204> 

when selected, also brings up a file dialog and essen- 
30 tially performs the same function as the "-o" command 
allowing redirection of the standard output file to an- 
other file in the computer system. Finally, the "Log 
file" button 205 also brings up a standard file dialog and 
is used in the same manner as the "-1" option for report- 
35 ing errors and other messages to the user at the comple- 
tion of testing. 

Numerous other options which are specified by nu- 
meric values are shown on window 200 as well. 206 and 
207 are fields which, when selected, allow the user to 
40 type numeric values into them. Field 206 is the same as 
The three target machines all will have the script the "-k" option and is used for specifying the rate of 
"Chooser QuickLoolcvu" run upon them as it is speci- keyboard input of the actor on the target machine, 
fied with the "-s" option with no number suffix. How- "Mouse speed" field 207 is similar to the "-n" option 
ever, each of these options has a different mouse speed used for specifying mouse movement rates of the actor, 
specified by the "-m" option. Also, the keyboard rate 45 The "Network Timeout" field 208, "Network Retries" 
for each of the targets is the same as specified by the field 209, "Patience" field 210, and the "Failures Al- 
M -k" option with no number suffix. lowed" field 211 all correspond with the "-timeout," 

Note that each of the lines in the above scripts are "-retries," "-p," and "-fail" options discussed with refer- 
followed by a character "a." This character indicates ence to the command interface above and have similar 
that the command continues onto the next line. There- 50 functions to their command fine counterparts, 
fore, the example given above is treated as one com- In addition, to the foregoing fields and controls speci- 
mznd line. fied above, window 200 also specifies four boolean 

Interactive Window Interface Invocation-FIG. 2 ^£? n ^£ ^Z^n ^^XT*!? 

certain options. The Trace On boolean field 212 acb- 

An example of the interactive window interface pro- 55 vates the "-dt" option discussed above, wherein certain 

vided by the preferred embodiment is shown in FIG. 2 variables and other information are displayed iterably 

as 200. Window 200 is displayed when the user activates for debugging of the script Further, the "Compile 

one of the pull-down menu options provided by the Only" option 213 is used for generating syntax errors of 

preferred embodiment This window provides all the the script sought to be executed. The "No threads" 

options provided by the command interface discussed 60 option 214 is selected for disallowing parallel execution 

above, but with an interactive graphical user interface of multiple tests using "threads." One can still run multi- 

instead of specifying various command line options. pie tests but the performance is slower than when using 

Most of the options shown in 200 of FIG. 2 are self **threads." This deactivates the multitasking feature of 

explanatory, however, they will be discussed here in the preferred embodiment which allows other actors to 

order to provide a clear understanding of the preferred 65 be busy while one or more actors waits for a transaction 

embodiment. Each of the fields is accessed by selecting on HO.to complete. The "Match Case Sensitive" option 

the option shown in window 200 using a mouse or other 215 is selected for activating case sensitivity on names 

cursor control device on the host machine. The user used on window 200 and the command script 



VII 


-tl 


"•:gozer" a 




-ml 


10 3 


a 








42 


M *:chuck" a 




-m2 


5a 


a 








-U 


"FaradsTwiddledee" * 




-m3 


1 a 


a 








•a "Chooser QuickLook.vu" 9 




-It 


30 
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The "Command Line" subwindow 216 is used for 
showing the command line counterparts to the various 
options selected in window 200. In addition, command 
line option 216 may be used by the user for entering in 
command lines directly, instead of selecting options in 5 
window 200. "Help" window 217 displays information 
about a command. The command that the user needs 
information on is specified in "Command Line*' field 
216. The last two options in window 200 are the "Can- 
cel" button 218 and the "VU" button 219. 218 is se- 10 
lected by the user for aborting from the current infor- 
mation defined in. the window as shown as 200 and 
exiting. The "VTT option 219 is selected for executing 
the options currently defined in window 200. Com- 
mands interpreted and executed by the host computer 15 
of the preferred embodiment will now be discussed. 

Interpretive Commands 

The preferred embodiment essentially sets forth an 
entire interpretive "script" language for performing 20 
tests upon target machines. Scripts (command language 
routines) written in this language are interpreted by the 
host computer and, depending upon information cur- 
rently retained in the host, forwarded in the form of 
packetized command(s) to the target machine for re- 25 
questing various information from the target across 
network 110 or performing specified actions on the 
target The host computer provides the script interpre- 
tation functions and the target machine emulates key- 
board and mouse activity as if a user was operating the 30 
target This interpretive language provides certain func- 
tions provided by other interpreters such as a plurality 
of variable types which may be defined, and expressions 
which are evaluated using rules well-known to those 
skilled in the art, such as those used in the BASIC and- 35 
/or C + + or other high level prograniming languages. 
Expressions may be either variables, numbers, symbolic 
identifiers, relational or logical expressions, among 
other things. Expressions and values permitted by the 
preferred embodiment will not be set forth in detail 40 
here, however, it can be appreciated by one skilled in 
the computer programming arts that these expressions 
and/or values will be parsed and/or interpreted using 
rules which are well-known. 

Two of the primary functions provided by the pre- 45 
ferred embodiment are: (I) emulating user actions on 
the target computer; (2) determining the state of the 
target computer (for example, to determine the results 
of the emulated user actions). The state of the target 
machine's display may be referenced using "descriptor" 50 
expressions. 

Descriptor Expressions 

Descriptor expressions are the means by which a 
script describes something that exists on a target ma- 55 
chine. These are used to describe various user interface 
objects such as windows, menus, and buttons on the 
display of the target, but are also used for referencing 
the state of the target, such as the type of CPU, version 
of the operating system, the current application run- 60 
ning, etc. Descriptors are used by the script to specify 
the state of user interface objects on the display, on the 
target machine. Descriptors may also be used to identify 
actors or other items in the host or target. Using de- 
scriptors, the script can distinguish one entity from 65 
another using a minimum amount of information. A 
summary of descriptors which may be specified in the 
preferred embodiment are as follows: 



application 


button 


checkBox 


contentltem 


control 


ediiText 


icon 


keyboard 


menu 


menultem 


mouse 


picture 


popup 


radioBuiton 


screen 


scroll Bar 


staticTeM 


system 


target 


time 


user Item 


window 







Each descriptor is enclosed within brackets, and has the 
following format: 

[descriptor-type trait 1, trait 2, etc.]. 
Traits define specific attributes of each of the descrip- 
tors specified by one of the above names. A window, for 
instance, will have a particular position, and/or title 
associated with it Some of the traits supported by the 
descriptors in the preferred embodiment are set forth 
below. Traits may be used by the script for defining 
particular actions which need to take place, or may be 
used within the script to determine the current state of 
the target These are performed using the "match" and 
"collect" expressions which are discussed below. The 
traits of each of the descriptors will now be discussed. 

Descriptor Traits 

Window Traits 

Each of the following is used to define the traits of a 
given window descriptor. A window descriptor may be 
used either to specify a window for selection, or it is 
returned by the host machine to the script for represent- 
ing the current state of the target machine. A window 
descriptor is specified using the following format: 

[window trait 1, trait 2, etc.] 
The traits for window descriptors are as follows: 

t: This is used to specify a window's title. For in- 
stance, in the screen 300 shown in FIG. 3, window 
310 will have a title field specified by the "t:" op- 
tion as "MacPaint 2.0." Examples of descriptor 
statements which may be referenced are as follows: 

[window t:*MacPaint 2.0*] 

[window t:/Mac Paint 2.0/] 

[window t:/MacPss/] 
Each of the foregoing expressions may be used to 
refer to window 310 shown in FIG. 3 because that 
window has the title "MacPaint 2.0." The name 
must be delimited using either the \ "/characters. 
In the third example shown above, the 44 sr" wild 
card character may be used to match any remain- 
ing characters left in the title because it still 
uniquely identifies window 310. 

o: This is used to specify the rank (ordinal) in order- 
ing of the visible windows in the target window 
list. This is a numeric value, with the rank of the 
front window receiving a rank of one and any 
subsequent window n windows after the front re- 
ceiving the rank n. For instance, the expression: 

[window o:l] 
uniquely identifies window 310 shown in FIG. 3 
because window 310 is the front-most window 
shown in screen 300. Any subsequent windows 
such as window 330 shown in FIG. 3, will receive 
a subsequent n rank (ordinal) value. Window 330, 
in the example shown in FIG. 3, is uniquely identi- 
fied using a 3 because it is the third window back as 
it appears to a viewer of the display. Window 330 
therefore may be uniquely referred to with the 
descriptor "[window o-3]." 
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s: This is used to specify a window style. A window 
has traits associated with it using one of the follow- 
ing symbolic values: 



document 

dialog 

da 



shadow • 
plain 



A "document" refers to a standard window. This is 10 
the type shown as 310 in FIG. 3. A "dialog" is a 
window which requires some information. A "da" 
is otherwise known as a "desk accessory" in the 
Macintosh brand operating system and has another 
specific format (not shown). A "shadow" window ^ 
is one which has an apparent shadow on the dis- 
play. Finally, a "plain" window is one which 
merely presents information to a user of the system. 
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window specified in some other unique manner 
may be used in conjunction with a position value to 
indicate a position relative to the window specified. 
Examples of the use of the foregoing traits will now 
be discussed For instance, with reference to FIG. 3, 
window 310 may be referenced by the following: 
[window srdocument c:true z:true g:true r: {87, 116, 
297,254}] 

The "s;" option specifies that window 310 is a document 
window, "c:" specifies that it has a close box, "g:" speci- 
fies that it has a grow box, and "z:" specifies that it has 
a zoom box. As discussed above, the close box is shown 
as 311 in FIG. 3, the grow box is shown as 313 in FIG. 
3, and the zoom box is shown as 312 in FIG. 3. Further, 
the window has the coordinates defined as (87, 116, 297, 
254) which is the global position value on screen 300 of 
FIG. 3. 

Window 310 may also be defined by the following: 



[window k: { [scrollBar t:" r: { 87, 237, 281 , 253 ) sr{ 0,0 } ertnie 1. 
[scrollBar t:" rr { 280, 154, 296, 238 } s:{ 0,100 } e:true ] } ] 

The plain window has no user interface or other 
control feature associated with it 

c: Used to specify whether the window has a "close" 25 This descriptor indicates that the window has certain 
box. A close box is shown as 311 on 310 of FIG. 3. attributes associated with it as defined by the "k:" op- 
Selecting this area of screen 300 using a cursor such tion. As shown above, the "k:" option defines that it has 
as 301 shown in FIG. 3 causes the window to disap- two scroll bars, whose absolute positions are inH^t^ 
pear from the display. This is a boolean value, as shown in the example. Each of the scroll bars has 
which resolves to either true or false. 30 certain traits associated with it as defined by title option 

z:.This is used to specify whether the window has a (each does not have a title though), and the **r:" option 

'•zoom" box. In FIG. 3, window 310 has a "zoom" defining their absolute positions. The scroll bars are 

box which is shown as 312. This causes a fixed shown as 314 and 315 on FIG. 3. Each of the scroll bars 

increase in size of windows 310. Again, like the has two additional traits associated with them, the "s:" 

"c:" operator, this expression is a boolean and eval- 35 option and the "e:" options for indicating the state of 

uates to either "true" or "false" in the script lan- scroll bars 314 and 315. 

guage of the preferred embodiment. Content Item Descriptors \ 

g: Used to specify whether the window has a "grow" t: Used to specify the text associated with a button, an 

or "size" box. This is shown on window 310 in edit box, or the title of a popup window, etc. 

FIG. 3 as 313 and is used to increase the window's 40 w: Used to specify the window in which the identi- 

size on screen 300. fied object resides. 

k: Used to list additional objects contained within the r: Used to specify the dimensions of the rectangle (in 

window. This descriptor may have any of the fol- global coordinates) in which the object is specified, 

lowing attributes: The syntax for the item is {left, top, right, bottom 

45 }. 

e: This value is used to specify the enablement of an 
item. In the example shown in FIG. 3, all of the 
items within 310 are currently enabled, therefore, 
they will have an "e:" value evaluating to "true." 

50 The other windows shown in FIG. 3 such as 340, 
350, and 360 are not enabled and, therefore, will 
have "false" e: values associated with them. 

Each of the sub-descriptors defined under the "k:" Control Descriptors 

option may have traits similar to the "window" These traits are used for referring to control items, 

trait discussed in this section. 55 h: This value specifies the highlight state of the con- 

n This is used to specify the dimensions of the bound- trol. This evaluates to a numeric value at run time 

ing rectangle of the window. This may be ex- which ranges between zero and 255. 

pressed in either global or local coordinates. s: This is used to specify a control setting of an item 

Global coordinates are those that form an absolute on the display. It is used with two numeric values: 

position on the screen. In other words, an object 60 a first value indicating the state of the item; and the 

that is bounded at the very top left portion of a second value indicating the difference between the 

screen such as 300 shown in FIG. 3 will have a maximum and minimum values. Therefore, for an 

starting coordinate at position (0, 0), The coordi- item which has a range through which it may 

nate may also be expressed as a value relative 1 to a move, the first value will represent the position 

window. The format of the relative coordinate is 65 relative to the minimum or maximum values. In the 

currently undefined, however, it is contemplated analogy of a fraction, this may be viewed as the 

that in an alternative embodiment, a window with numerator. For a scroll bar, such as 314 or 315 

either an ordinal (rank) value, a position value, or a shown in FIG. 1, the marimum range is repre- 
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contentltem 
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userltem 
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sented by the second value (the denominator) is 
either the top or the right-most value in the item. 
For example, a scroll bar having a maximum range 
of 100 through which it may move and residing at 
halfway along the bar may be referenced by: 5 
k; {[scrollBar s: {50, 100}]} 
Boolean control items such as check boxes, radio 
buttons, or other boolean control items have a 
difference between minimum and maximum values 



fied by the "o:" option) has an enablement value of 
"true." This is because the title for this menu item is not 
dimmed as shown as 414 in FIG. 4. Similarly, options 
415 and 416 are not enabled. The "Select All" option 
417 and the "Show Clipboard" option 418 are enabled. 
The menu item list is terminated by the "}" character. 
For a multiple level hierarchy of menus as shown in 
FIG. 5, the following series of descriptor statements 
may be used: 



[menu ^Hierarchy* o :3 e:tnie 

i: { [mcnultem t 'Level 1 Item ro:lfc"c: M c: true 

h: { [raenultem t:'Menu 65 Item P o:l k:' * c:* ' eitrue], 
[mcnultem t:*Menu 65 Item T o3 k:' ' c:* * e:tnie], 
[metmltem tr'Menu 65 [tern 3' cc3 L*' * c:' * ertrue] > 
[menultem t: 'Level 1 Item 2' o:2 kr* * c:' ' e: true], 
[menultem t: 'Level 1 Item 3* o:3 k:' 'c"e true] } } 

of one. Therefore, they only have two states 
(which is to be expected for a boolean function). 20 
Menu Descriptors As shown in FIG. 5, the items listed above represent the 

These traits are used to describe the state of a menu mul tiple level pull-down menu 510. As shown in FIG. 
on a target machine. The traits are as follow: 5 » ^ title "Hierarchy" 511 is indicated by the fc option 

t: Used to specify the tide of the menu. ^ value for that option, because it is the third 

o: Used to specify the rank (ordinal value) of the 25 title m menu bar 520, ** therefore a 3 - 
menu in the menu bar. It evaluates a numerical ^ items m **** mcnu m fe^d using the "i:" 
value at run time. For instance, the first menu in the °P tion » wi** 1 ^ first "Level 1 Item 1" 512 being se- 
menu bar from left to right will have an ordinal lected * ^ * indicated ' m descriptor statements 
value of one. Subsequent menu items will have a above ' bv ^ " h: " °P tion - ™ s °P^ on bein g selected 
value n wherein n is the number of menus from left 30 causes . the next menu 513 t0 WV** 1 shown m F 10 - 5 
to right of the particular menu. which is defined as a subset of the first menu item 512 in 

e: Specifies the enablement of the menu. This evalu- ^ descri P tor list The end of each of the descriptors 
ates to a boolean value at run time. for items 516 » 517 » and 518 ^ terminated by char- 

i: Specifies the items contained in the menu. It evalu- acter * Then » ^ remainder of the menu item list for 
ates to a list of menu item descriptors. 35 menu . 510 showing items 514 and 515 is shown in the 

An example menu and menu item descriptors is descriptor list 
shown as follows: Menu Item Descriptors 

Menu item descriptors are used to describe the state 
of menu items on a particular menu of the target ma- 



[menu tfEdif o:3 ertme chine. It has traits similar to the descriptors described 
K ^V nd 7 0t ° : ! \ e:fabc] ' 40 above, with some menu item-specific traits. 

[menultem t: - o:2 k: c: eifakel, . e + + 

[menultem t:'Q»r o* k:'X' c:' ' erfaise], t: Specifies the menu item text 

[menultem t:'Copy' o:4 lu'C c:' ' etnie], m: Specifies the entity which owns the item. It usu- 

[menuitem t:'Paste* o:3 k:*v c:* * erfaise], ally indicates either the menu which owns the item, 

B£ SS£ ^^^Lue]. 45 » * ™™ W * Ch °^ * e * 

[menultem t:*-' o : 8 k:' * c:' * erfalse], be another menu ltem which mdicates that the 

[menultem t:'Show Clipboard* o:9 k:' * c: 1 ' c:true] } ] . menu is a hierarchical menu. 

— — _ — _ _ _ _ — _ _ _ _ _ 0; Sp^y-jgg jjjg ran j c c f j tem wthin the submenu. 

The menu defined by the above series of descriptor * Sf^S^W^ *? ' ft**" 8 £° 

statements is shown as 410 in FIG. 4. The menu's title 50 me fc T" ^board equivalent (a specific 

"Edit" is specified by the "t:" option. This corresponds *»J*««> sequence) may be entered to se ect the 

withthenXneofthemenu411attheto P ofscreen400 B .'£^^£T g ^^TL M 

shown in FIG. 4. Further, the rank of the menu is "3" as c: S^^L ™ k f "f by ™ 

specified by the "o:" option because the name "Edit" ,tem ; 11 mus b . e en ? osed m ° r . d . oub ' e 

411 is the third item on'menu bar 420 from left to right 55 ™* ev fT t0 * ■*"» ™» 18 

after the symbol 421 and the "File" title 422. Because w^taS? menu 

the menu is enabled (it is enabled if the option 411 is not . . c^-r„ e ?™/ ... 

dimmed), the enablement state specified by the «e:" t : w ^ * e menu . ,tem .» , 

option is "true." Further, items are defined within the h: ^* er * e ^ « luerarchical or. 

menu by the "k" option. Each of these is specified as 60 j. f ««?» 15 *« fl ?* " ^ *«. ™' 

follows. The first option 412 has the title "Undo" speci- JTS?^ ?f b , m f nU descn P tore enclosed 

fied by "t:," an ordinal (rank) of "1" specified by "o:" the I and > characters, 

has a corresponding keyboard equivalent of "Z" speci- 9 ^ th " ?f a statement m v av desci ? be 

fied by the "k:" option as shown in FIG. 4 (see discus- f.^fff 0 ^ 031 ,,em m 501660 500 » shown "^S 

sion below), and it is not enabled (it is dimmed) as speci- 65 tte foUowm S statement- 

fied by an "e:" option of "false." In contrast, the [nlelluItem t<Uvd , Itan rm:tineM| 

"Copy" menu item 414 shown in FIG. 4 and the above b'Hierarchyoa etruejoj lu-c-eanie] 
script example (which has an ordinal value of 4 speci- 
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The selected menu item 512 corresponds with the hier- 
archy menu tide 511. Therefore, the <4 m:" option in the 
statement returns a menu with title "Hierarchy" and 
with an ordinal value of "3." This is used when the' 
script wishes to determine the menu which owns the 
currently-selected menu item. 

Another statement which would be printed to de- 
scribe "Menu 65 Item 3 ," shown as 518 in FIG. 5, 
would return the following statement: 



18 



[menultera fc'Menu 65 Item 3' 

m:[mcnultcm C'Levd 1 Item V 
m:[menu ^'Hierarchy* 0:3 e.tmc] o:l k:* * c:* * eftnie] ] 
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As is shown, the menu item 518 with the title "Menu 
65 Item 3" is indicated by its parent menu item 513 
"Level 1 Item 1" of menu 510 as indicated by the "m:" 
descriptor in the text above, and the previous menu title 
"Hierarchy" 511 is shown as the parent of that menu. It 2 o 
can be appreciated by one skilled in the art that any 
number of submenus may be uniquely identified in this 
manner. 

Keyboard Descriptors 

These items are used to describe the state of the key- 25 
board attached to the target 
t: Specifies the type of keyboard. These are used, in a 
preferred embodiment, from the Macintosh brand 
family of computers. The keyboard values for the t; 
command are derived from the literals defined 30 Tar S ct Descriptors 



In this case, the mouse cursor is at the position x=234 
and y = 187, and the mouse button is depressed. 
Screen Descriptors 
The traits for screen descriptors are as follows: 
r: This specifies the rectangle are surrounding the 
coordinate space that the screen is displaying. It 
has the format: 
{left, top, right, bottom} 
For instance, a screen that has a display which is 
512 pixels wide by 342; pixels high and whose upper 
left comer resides at the origin of the graphic sys- 
tem's coordinate space will have the value: '[screen r: 
{0, 0, 512, 342}] 
m: This is a boolean value used for target computer 
systems which have a main screen and auxiliary 
screens. The value is evaluated as "true" if the 
screen specified is the "main" screen. The main 
screen will typically have the menu bar such as 520 
shown in FIG. 5, and auxiliary screens will be used 
for displaying other types of data. 
Application Descriptors 
t: This is used to specify the name or title of an appli- 
cation program. Typically, only the active applica- 
tion is accessible. For instance, if a target machine 
was requested to send the name of the application 
"MacWrite" which is currentiy active, then the 
target would return the following statement: 
[application t:"MacWrite"]. 



under keyboardType constant in the publication 
*Tnside Macintosh, Volume V," at page V-8. 
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These are also defined as having the same literal 
values in the interpretive language of the preferred 
embodiment. 

s: This is used to specify the "key script" associated 
with the keyboard. This is used for the Macintosh 45 
brand family of computers and is described in more 
detail in the publication "Inside Macintosh, Vol- 
ume V," at pp. V-297 to V-298. This is used for 
specific character sets (such as Arabic or Cyrillic) 
used by various keyboards of possible target ma- 50 
chines. 
Mouse Descriptors 

These are used to describe the state of the mouse 
attached to the target, 
p: This is used to specify a mouse cursor position. 55 
This generates a list of two numerical values con- 
tained within the characters and "}." The first 
value is an x coordinate and the second value is a y 
coordinate. This is a global position on the screen 
of the target machine. $0 
b: This indicates whether the mouse button is down 
or not on the target machine. This value evaluates 
to a boolean value. "True" means that the button is 
depressed, and "false" means the button is not de- 

65 



An example of a mouse descriptor statement is indicated 
as follows: 
[mouse p: {234, 187}b:true] 



These traits are used to describe the state of the target 
machine. 

t: Specifies the target name. This is the **user name" 
specified by the target in the "Chooser" program 
of the Macintosh brand operating system software 
of Version 6.0 and later. This evaluates to a string 
and allows a target machine to be uniquely identi- 
fied (assuming that all the targets in a certain zone 
had unique names). 

2: The network "zone" name. Zone names identify an 
arbitrary set of computers in a network and are 
described in more detail in the publication "Inside 
Appletalk" at pp. 8-1 to 8-23. 

n: This specifies the target's model name. In the pre- 
ferred embodiment, these are literal symbolic val- 
ues which are used for identifying the target ma- 
chine. These are generally found within the system 
ROM of the target machine, in the preferred em- 
bodiment, which uses the Macintosh brand family 
of personal computers. 

r: This specifies the target machine's RAM (random 
access memory) size in kilobyte units. This is an 
integer value. 

a: This is essentially the same as the "t:" application 
descriptor discussed above. This describes the ap- 
plication currently active, however, it is contem- 
plated that in alternative embodiments this option 
may be used for returning a list of all applications 
running in the target machine 

s: This specifies a list of screen identifiers. 

m: This specifies the state of the mouse attached to 
the target (see "Mouse Descriptors" above). 

k: This specifies the state of the keyboard attached to 
the target machine (see "Keyboard Descriptors" 
above). 
System Descriptors 

v: This is used to specify the version of the system 
software in the target machine. 
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s: This specifies the system script of the operating This will return the characteristics of the front-most 

system software in the target machine. This is simi- (with the rank or ordinal value equal to one) window on 

lar to the script described with reference to the the screen, as shown as 310 in FIG. 300, which has an 

keyboard descriptors above, however, it applies to ordinal value equal to "L" It will return all of the traits, 

the operating system instead of the keyboard. 5 which will be printed out as follows (note that the 

Actor Descriptors "print line" or "println" statement has the same effect 

t: This specifies the name of the actor (see the discus- as that used in the Pascal programming language, i.e., it 

sion of actors above). This identifies process associ- causes the specified item to be "printed " to the stan- 

ated with a target machine in the host machine. dard output file): 

u: This specifies the name of the target machine under 10 

the actor's control. 

Time Descriptors [window ti'MacPaint Iff ^document 

y: This specifies a year. It must evaluate to a numeri- t^^mie 

cal value. • n { 87,' ne, 297, 254 ] 

m: This specifies a month. It must evaluate to a nu- 15 M [scroll Bar tr *n { 87, 237, 281, 23 1 &{ 0,0} citrue l 

merical value between 1 and 12. [scrollBar t:' r. { 280, 154. 29* 238 } $:{ o.o } 
d: Used to specify a day. This must evaluate to a eunie]}]. 

numerical value between 1 and 31. 
h: Used to specify hours/minutes. This is specified ^ addition, the * 4 match" statement may be used to iden- 

using military time, and it is an integer between 0 20 tify all windows, in this example, having certain values. 

and 2359. For instance, the statement: 

s: Used to specify seconds. Must evaluate to a number println match[window t:"MacPaint 2.0"]; 

between 0 and 59. would result in the same values being printed out as 

above. 

Special Operators Used by the Preferred Embodiment 25 in addition, wild card characters (such as the "=") 
The script language of the preferred embodiment mav be used. So, if a given window or set of windows 
uses many of the conventions applied by standard pro- has certain attributes associated with it, they will each 
gramming and/or scripting languages. Many of the be returned in order. For instance, as discussed again 
commands and syntaxes used in the preferred embodi- with reference to window 410 in FIG. 4, the statement: 
ment are similar to that used in the C programming 30 println match[window t:/Mac~/]; 
language with some exceptions. Except for the descrip- would result in the same set of descriptor statements as 
tors and other constructs discussed above, arithmetic mentioned above. Note that the **match" expression 
operations, the syntax (all statements must end with a generates only one descriptor, which has the highest 
";"), assignment operators (":=") and evaluation rules ordinal value on the display of the target machine's 
are handled in a similar manner to the C programming 35 screen. . 

language. Therefore, a detailed description of the rni w p^ci^c 

scripting language will not be set forth here. However, ^onecx tixpressions 

them are some functions provided by the preferred As an alternative to using a "match" expression, the 
embodiment in order to evaluate the state of target preferred embodiment provides for generating a list of 
machines. These include the "match," and "collect" 40 descriptors for targets or actors having particular attri- 
operators. butes. The syntax of the "collect" expression is virtually 

identical to that of the match expression. Instead, col- 
Match Expressions lect generates the list of all descriptors having the speci- 
Match expressions are used in scripts of the preferred fi ed traits. Therefore, if a collect expression was used 
embodiment to return information about an item having 45 with the descriptor ''window" in the following manner: 
a descriptor evaluating to a specified value. In other 'println collect[window t:/Macss/]; 
words, information about a specified target or a sped- then, a list of all the windows shown in screen 300 of the 
fied menu on a target machine may be returned by target would be generated as follows: 



{ [window ^'MacPaint 2.0* s:document o:l c:tnie zrtrue g:tnie 
n{87, 116, 297,254} 

k:{ [scrollBar t:' V. { 87, 237, 281, 253 } *:£ 0,0 } cArue I 

[scrollBar t:' *r: { 280, 154, 296. 238 } $:{ 0,0 } e:true J }], 
[window t:' AppleLink Folder* document o:2 c.-true zztmc g:true 
r:{203, 93.442.246} 

lt:{ [scrollBar t:' 'r: { 203, 229, 426, 245 } sK 0,0 } e:tnie 1, 

[scrollBar t:' 'r: { 425. 131. 441, 230 } s: { 0,800 } c:truc] }], 
[window tfMacWrite 5.0* s:document o:3 c:true rime g:true 
r:{l55, 59,431, 176} 

k:{ [scrollBar t:' *r: { 155. 159, 415, 175 } sK 0,0 } e:irue 1, 

[scrollBar t:' *r: { 414, 97, 430, 160 } s: { 0.48 } e:tme] }), 
[window t:' Applications' 8:document txA c:true ctme g:true 
r: { 29. 58, 188. 215 } 

k:{ [scrollBar u* *r: { 29, 198, 172, 214 } 0,0 } eSrue 1 
[scrollBar V *r: { 171, 96. 187. 199 } s: { 0.48 } e:tnie] }j } 



issuing a "match" instruction with information about 65 As can be appreciated by the foregoing discussion, this 
that item. For instance, in the example shown in FIG. 3, represents all the windows 310, 320, 330, and 340 as 
screen 310 may be evaluated in the following manner: shown in screen 300 of FIG. 3. Similar statements may 
'println match[window o:lJ; be made for menus, menu items, etc 
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Dot Expressions selectecl toe " m: " option. It can be appreci- 

ated by one skilled in the art that using the "select" 
Particular waits may be obtained from descriptors. statement for menus and/or menu items using the de- 
Tnese are done, in a manner similar to those techniques scriptors specified above that any menu item in a screen 
currently used in the programming arts, by using the 5 such as 600 may be uniquely described. For instance, 
trait as a field of a umquelyridentified descriptor to another way to uniquely specify menu item 651 in menu 
return the value for the tnuLThis is done using a "dot" «(, b with the following statement: 
SwSr ? "stance in the example shown in screen select[menultem t:'Menu 76 Item 3']; 
b?u!eT s^ments such as follows may Because the title "Menu 76 Item 3" 651 is unique (the 

x:=match[window o:ll; 10 «■«» item «"» titte ). will be se- 

orinfln x t* ' lected. 

which would produce the following output in the stan- c . In t ^ 0 . ther fmbodiment. a "popup" menu may be 

dard output file: selected in a similar manner by substituting the refer- 
ence to "Menu" for items with "Popup" to select a 

MacPaint 2.0. 15 P°P U P menu with a specific title. 

This essentially returns the "t:" 'field" of the window Selecting Windows 

with the ordinal value of "1." This is window 310 in Windows are selected m a similar manner by specify- 
screen 300. The "t:" field is the title of the window ae command "select" followed by a window de- 
shown as 314 in FIG. 3. 20 scri P tor * This Drin ep window selected to the front of 

the display by issuing a command to the target to click 

Controlling Actions of the Target Machine on any exposed region of the window in order to acti- 

The control of the target machine is performed in the vate * e window, 

preferred embodiment by interpreting instructions Dragging Windows 

which identify descriptors residing in the target Then, 25 *° com P uter systems used by the preferred embodi- 

the script may manipulate the items identified in the ment » windows may be moved around on the display 

descriptor in various ways. Selecting menus such as the screen. This is accomplished using the "Drag" com- 

puli-down menus shown in FIG. 4 and 5 in the pre- niand which operates on a descriptor of type window, 

ferred embodiment is done using the "select" command. Depending on the parameters applied to the "Drag" 

The "select" command is used in conjunction with a 30 command, different types of movement will be per- 

menu or menu item descriptor in order to either select a formed on the window. 

menu to be momentarily displayed or to select a particu- a: This specifies that the window should be moved to 

lar menu item on a menu and perform that action. For an absolute position in global coordinates. An x and 

instance, the following command may be issued to y value of the new position of the window is speci- 

cause a pull-down menu to be momentarily displayed: 35 fied after the a: option enclosed by "{" and "}." 

select[menus fcTools*]; The first value is the x coordinate and the second 

In order to select a menu item, a menu descriptor is value is the y coordinate, 

used to indicate the appropriate menu to select, and a r: This specifies a relative change of position. Two 

menu item descriptor under that menu to select The coordinates are specified again delimited by "{" 

keyboard selection of the menu item may be emulated if ^ and "}" in the preferred embodiment This means 

the k: option is specified with a boolean value of that the current position is offset by those values, 

'true" associated with it For instance, in order to "pull Sizing Windows 

down" (select) ■ l menu item entitled "Plain" under a Windows may also be resized by specifying the corn- 
menu entitled Style" using its keyboard equivalent, the ^ » S ize" followed by a window descriptor. Several 
£L P**™ 8 * **** 45 arguments specify how the sizing will be done. 

v ^ , • h: S P cdfies ** ^ ^er the size operation. 

1 ^ % £ I ^ lteB J 1 ? no keyboard equiya- This valuates to a numerical expression, 

em, then the k: opnon would be used with the yalue w: Specifies a window's width after the "size" opera- 

"false" or not "k:" would specified at all (the default). If . tion 

^T*"? * «?^. w^Je^" 50 r: Specifies a change in size relative to the current 

*e keyboard equivalent is not used. As another exam- size. This is a two numerical value expression en- 

P mV^^^r 3 ^ ? ferC c nCed S ^° Wn closed within "{" and "}" which specifies how 

m HG % Z^!^^rT^ 65 « much ** ™ dow be changedTsize rT 

moment ^ tive to current ^ va * ue specifies the 

55 change in width, and the second value specifies the 

change in height. 

select [menultem t:'Menu 76 Item 3' : Closing Windows 

mimenultem t* 'Menu 67 item 3* Closing windows may be accomplished by selecting a 
m:[menuitem tfLevel l Item 3* gadget such as 313 in a window such as 310 of FIG. 3. 
*fr™»t:Hi Crare hym 60 This is performed using the script language of the pre- 
ferred embodiment by specifying the command "Close" 
As is shown in FIG. 6, the lower-most menu item 651 followed by a window descriptor, 
is specified first in the select statement. This is specified Zooming Windows 

by the "b" option used with the title "Menu 76 Item 3." This is performed using a similar syntax to closing a 
Then, the previous menu item 641 is selected using the 65 window, however, a gadget such as 312 is selected in a 
statement "m:[menultem t:*Menu 67 Item 3'." The window such as 310 shown in FIG. 3 using the corn- 
menu item previous to that "Level 1 Item 3," item 631 mand "Zoom." 
is also specified, and the menu title entitled "Hierarchy" Scrolling Windows and Other Objects 
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The command "scroll" is used to scroll windows and 
other devices which have a scroll bar such as 314 or 315 
shown with reference to FIG. 3. This is performed by 
emulating a user selecting the slider on a scroll bar and 
moving it to a second position causing text or other data 
contained within a window to be redisplayed or 
scrolled to a new position in the document (or other 
data) in the window. The "scroll" command is followed 
by a descriptor of type "scrollBar," and then is followed 
by an argument specifying the type of scrolling to be 
performed. These arguments are specified by the fol- 
lowing: 

a: This is an absolute value which is treated as a per- 
centage between maximum and minimum values as 
discussed with reference to the scroll bar descrip- 
tor above. This is a list of two numbers delimited 
by "{" and "}" wherein the first number is treated 
as a numerator and the second number is treated as 
a denominator of the fraction indicating the rela- 
tive movement of the thumb device in the scroll- 
bar. 

r: This is a relative scroll function. It is also treated 
like a fraction, however, it uses the remaining posi- 
tion left in the scroll bar to determine how much it 
should move. For instance, the fraction {1, 2} spec- 25 
ifies that the scroll bar should be moved 50% of the 
remaining distance between the current position of 
the thumb and the end of the scroll bar. 
Selecting Boolean Values 

Selecting operators such as buttons, radio buttons, 30 
and checkboxes on a display may be performed in the 
preferred embodiment using the "select" command. 
This is similar to the "select" command used with refer- 
ence to window descriptors above, however, a control 
descriptor follows the "select" command. Therefore, 
the select command will be followed by either a de- 
scriptor of type "button," "radio button," or "check- 
box." This causes the operator on the display to be 
selected by the cursor. The effect that this has on the 
operator depends on the type of operator. For some 
operators, like buttons, the button state is toggled only 
momentarily. For checkboxes, the item is toggled from 
the previous state. For a radio button, the selected but- 
ton is turned on and other radio buttons are turned off. 
Each of these conditions may be tested for on subse- 
quent "match" or "collect" expressions. It is contem- 
plated that other operators may be used within the spirit 
and scope of the present invention. 
Typing Characters 

Emulating user-typed characters on the target com- 
puter is performed by specifying the "type" command 
followed by one or two arguments. These arguments 
are: 

k: This specifies keystrokes to be typed by the target 
machine. The option "k:" is followed by a list of 
items to be typed by the target machine enclosed 
by a "{" and "}." This may include, among other 
things, numbers, special characters, or text en- 
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which corresponds to corresponding typeable keys 
on target machines, 
p: This causes the target machine to emulate the use 
of a numeric keypad on the target A boolean value 
follows the "p :" option and indicates whether the 
numeric keypad should be used or not When the 
glean value following the "p:" option is "true," the 
numeric keypad is emulated. When false, it uses the 
standard keyboard. The default does not use the 
keypad. 
PressKey and ReleaseKey 

Keyboard data entered with the use of the "type" 
function are pressed and released in one script state- 
ment To press and release keys separately (over multi- 
ple script statements) the commands "pressKey" or 
"releaseKey" must be used in place of the "type" com- 
mand. In this manner, keys are held down over multiple 
script statements, and can be each released individually. 
Like the "type" command, the "pressKey" and "relea- 
seKey" commands are followed by a "k:" option fol- 
lowed by a series of keystrokes delimited by "{" and 
"}," each of the keystrokes within the delimiters being 
separated by commas. 

Controlling the Mouse 

The control of the cursor position normally per- 
formed by the mouse is emulated using the "move" 
statement. As with moving windows, the move may be 
either absolute or relative. The "move" command is 
followed by the requisite "a:" or "n" options with the 
mouse positions specified as a list of two numeric values 
delimited within a "{" and a "}." As with the "move" 
command applied to a window, the "move" command 
may be applied to a mouse, followed by {x,y } wherein 
x is an x coordinate (or a change in the x coordinate if 
the "r:" option is specified), and y is a y coordinate (or 
a change in y if the "r:" option is used): Other options 
for controlling the mouse are done using the commands 
"Click," "Doubleclick," "PressMouse," and "Release- 
Mouse." "Click" is used to emulate a single click of a 
mouse button within one script statement. "Double- 
Click" is used for emulating two rapid clicks of the 
mouse button in one script statement. This is used to 



closed withmquotetion marfa I^h of the here in «, accomplish a selection or activation of certain item(s) 
the list enclosed by "{" and «}" « dehmUed by ^ ^ screen in order to launch application 



commas. The following special characters are de 
fined as literals and may also be specified generat- 
ing the ASCIT equivalent: , 
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programs or other functions as is well-known to those 
skilled in the interactive interface arts. Similar to the 
"PressKey" and the "ReleaseKey" commands, the 
65 "PressMouse" and "ReleaseMouse" commands are 
used for emulating the depression or the release of the 
mouse button over several script statements. If a "Press- 
Mouse" command is issued with no corresponding 
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"ReleascMouse" statement, then the button continues In the first statement, wherein the statement references 
to be emulated depressed. the window with the title "Window," the title string in 

Heuristic Matching Algorithm " the sdect stotement is not complete but matches six out 

of seven of the characters in the title ('Windowl"). 
Matching is the process used in the preferred embodi- 5 Therefore, the matcher recognizes the fact that there is 
ment of finding the intended object(s) in the target to an 86 percent (6 out of 7 characters) match for this 
act upon. Matching is performed by a "matcher" in the particular trait 

host computer whenever control of an item in the target The second statement referencing the window with 
is attempted, or the state of the target machine is re- the title "Windowll" matches the title completely for 
quested using either "match" or "collect" expressions. 10 the first seven characters, however, it has one extrane- 
Before. a user emulated action is performed, the match- ous character "1" which does not match the title of 
ing method used by the preferred embodiment ascer- window 710. Therefore, the matcher treats this as a 
tains the state of various objects in the target by issuing complete mismatch. The third example, referring to the 
commands (such as SendMousefj, SendFindWindowfJ. window with the title "lWindow" is also treated as a 
etc. discussed below) to the target to determine which 15 total mismatch because, even though all of the charac- 
objects on the target have the types of items described. ters match that in window 710, they are completely out 
Then, the matcher determines which of the items of order 

should be controlled using a heuristic matching algo- Another situation arises in which a script author spec- 
nthm. For uistance, in order to select or drag a menu ffies multiple traits to be associated with an object, how- 
item the following examples would be used: 20 eve r, one or more of the traits is incorrectly specified, 
selectlmenultem £W1 All of the traits incorrectly specified wffl generate a 
tog[window t:"Untitled'1a:{l00,100} ; zero percent match. However, in an example there one 
In these examples, a matching would be performed or more of the traits are correct, the preferred embodi- 
pnor to control of the items specified in order to per- ment uses a technique of weighting. Each trait is as- 
form the desired function. In another example, the 25 signed a specific we ight so that the matching of each 
match or collect expressions may be referenced di- trait Q f a descriptor can be totalled with other weighted 

iec }zl . j . r • j , trait values for the descriptor. The descriptor with the 

first_wmdow:=match[window o:l]; highest weight will be returned as the matching descrip- 

i th menUS:=C ° UeCt[ineilu]; f u t . tor. As an example, two windows are displayed on a 

In both cases a description of the target object (speci- 30 target machine which have the descriptors as follows: 
fied using a descriptor) b referenced and the matcher [window t: "Windowl"o:l . . . l(we will call it wl) 

Sf OV ^ y embod j ment must identif y and [window fc "Window"o:2 ... ](we wfll call it 

the object specified. The matcher finds all of the corre- w2 ) 

spending objects in the target machine which match the If a ^ attempts to access the target machine with the 

descriptor specified. 35 following statement: 

The preferred embodiment provides a heuristic select[window t:"Windowl"o31- 
matching algorithm for returning information given This select statement will be technically incorrect, 
descriptor traits that are incomplete. In addition, the From viewing the wl and w2 window descriptors 
marcher provides a means for returning descriptors above, there is no window displayed on the target ma- 
about objects or identifying objects on the display of the 40 ch in e which has a title "Windowl" and has a rank value 
target machme when the traits are incorrectly specified. of 2. However, there is a window with a title "Win- 
In this situation, the preferred embodiment assigns dowl" and there is a separate window which has a rank 
weights to different traits so that an approximation or of 2 . Therefore, the descriptor for either wl or w2 may 

•best guess about the objects referenced may be re- be returned depending on the importance placed on the 
turned. In this situation, the object with the highest 45 various traits. The importance in the preferred embodi- 
weight is returned. This process will be described with ment is accomplished by assigning each trait in a de- 
reference to the display screen shown as 700 of FIG. 7 ^ptor a weight (significance level) to determine 

u Window 710 in FIG. 7 can be easily described with which descriptor is the proper one to be matched. TWes 

the following descriptor statement: are most important so, m this example, the title field is 

[window title: "Window 1 o:l 20om:true closebox:- 30 assigned a weight of 35 and the rank field is assigned a 

true k: {[scrollbar . . . ], [scrollbar . . . ]}] weight of 25. Each percentage of niatching in specified 

Knowing what to expect, a script writer may therefore fidds is multiplied by the weight figure and each of 

identify wmdow 710 using a statement as follows: these products is totalled to achieve a total resulting 

select[window title: Windowl"]; significance matching value for the descriptor expres- 

The matcher can properly identify window 710 using 55 ^ For instance, in the *%elect" statement given above 

the above 'select" statement because there is a unique as applied to the windows wl and w2, w2 would have 

wmdow present on screen 700 which has the title "Win- a higher weight (86% match.35+100% 

dowL" The script statement may emit the remaining mateh-25=5510), than wl (100% match.35+0% 

traits of the window as specified above because the tide match.25=3500). Therefore, window w2 would be 

uniquely identifies it. Therefore, in this example, there is 60 returned as the matching descriptor, even though the 

no ambiguity about the window which is identified by title is not precisely correct Each of the traits for de- 

the select statement scriptors used in the preferred embodiment have prede- 

As other examples of attempting to reference win- fined weights as specified in Table 1 
dow'710 shown in FIG. 7, the following statements may • • 

be used: 65 TABLE 1 

select[window t:"Window"]; \ Trail Weights 

Select[windOW t:"Windowll"]; Actor DescrinwiT 

selectfwindow t:"l Window"]; name t go 
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TABLE 1 -continued 






Trait Weights 


check (mark) character u 


20 






Application Descriptors 






text 


t 


100 






Content! tern Descriptors 






(EditText/StaticText/Fcon/Picture/Userltem) 




text 


t 


35 




enabled 


e 


25 




rectangle 


r 


20 




window owner w 


20 






Control Descriptors 






text 


t 


35 




setting 


s 


13 




enabled 


e 


IS 




highiite state 


h 


IS 




rectangle 


r 


10 




window owner w 


10 






Keyboard Descriptors 






type 


t 


50 




keyscript 


s 


50 






Menu Descriptors 






title 


t 


<ft 
j\j 




rank 


0 


\n 
w 




enabled 


e 


10 




items list 


i 


10 






Menu Item Descriptors 






text 


t 


35 




rank 


0 


25 




owner 


m 


12 




keyboard equivalent k 


10 




check (mark) character c 


9 




enabled 


c 


9 




submenu 


h 


1 






Mouse Descriptors 






position 


P 


50 




button state 


b 


50 






Popup Descriptors 






text 


t 


30 




window owner w 


30 




rectangle 


r 


10 




enabled 


e 


10 




items list 


i 


10 




setting 


s 


10 






Screen Descriptors 






main screen 


m 


70 




rectangle 


r 


30 






System Descriptors 






version 


V 


50 




system script 


6 


50 






Target Descriptors 






text 


t 


40 




mouse 


m 


10 




screen list 


s 


10 




application list a 


10 




name 


n 


10 




keyboard 


k 


10 




RAM (memory) r 


5 




zone 


z 


5 






Time Descriptors 






year 


y 


20 




month 


m 


20 




day 


d 


20 




hour 


h 


20 




seconds 


5 


20 
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title or name field, for instance, thus giving a matching 
of that trait more significance than a match of a second 
trait, such as the rank trait. 

Another scheme performed by the preferred embodi- 
ment is the use of significance thresholds. For instance, 
in the example given above, if the significance threshold 
was 35, then the window title would be given priority 
over the rank trait. When a significance threshold is set, 
in the preferred embodiment, the heuristic matching 
algorithm first checks any and all traits with weights 
greater than or equal to the significance threshold, and 
will not test any of the non-significant traits (those hav- 
ing weights less than the significance threshold), if any 
of the significant weights returns a zero percent match 
(no match at all). If any of the significant traits is a zero 
percent match, then the entire match total is treated as 
if it were zero. This feature therefore gives the signifi- 
cant traits veto power over the remaining traits. Once a 
matching of a descriptor has been done, the appropriate 
command is issued to the target to cause the proper 
object to be referenced. 

Processing of User-Generate Scripts 

Interpretation of the scripts of the preferred embodi- 
ment is implemented by the host computer at run time 
using parsing techniques well-known to those skilled in 
the art The director maintains the state of each of the 
target machines in data structures retained in the host 
3Q Therefore, the current (or hopefully the most current) 
state of the target machine(s) is maintained in a data 
structure maintained by each actor. Updates to these 
data structures are performed at periodic intervals 
when the host requests information from the target 
machine(s) either as a result of the control of an item or 
a result of a "match" or "collect" expression. When a 
script command is interpreted by the host, the action is 
directed to be performed on the target using a series of 
basic commands issued to the target machine. Commu- 
nication is provided with the target via a network such 
as the Appletalk brand network manufactured by Apple 
Computer, Inc., using the Appletalk Transaction Proto- 
col (ATP) brand protocol. 

Commands Issued by the Host to the Target 

In the Macintosh brand computer system, the state of 
most user interface objects shown on the display of the 
machine is accessible through a series of low memory 
global data structures in the memory of the machine. 
50 This enables the system to place , the cursor and cause 
other activities to occur when the frame buffer in the 
target is updated. A program is run within the target to 
communicate with the actor in the host system which 
controls the target. In the Macintosh brand operating 
system running on targets of the preferred embodiment, 
this routine is initiated at computer system bootstrap 
initialization when the computer system checks for 
certain types of programs known as "INITS" or "sys- 
tem extensions" in the directory entitled the "System 
Folder." The target program known as an "agent" com- 
municates with the "actor" in the host by accessing data 
structures in the target while running in the background 
of the target during normal system operation. Messages 
sent to the target are directed towards a "socket" (a 
In an alternative embodiment, however, trait weights 65 process identified in the target, see "Inside Appletalk," 
may be variable allowing a user to modify those at pp. 9-18.to 9-20), and the agent interprets the corn- 
weights. Therefore, depending on a particular operat- mands issued over the network 110 in order to perform 
ing context, a user may modify the trait weights for a the desired function. These functions are performed by 



35 



40 



45 



title 
rank 
style 

close box 
contents list 
grow box 
rectangle 
zoom box 



Window Descriptors 
t 



35 
25 
10 
6 
6 
6 
6 
6 
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60 
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the agent at network interrupt time or during a periodic mation for the mouse, if the "WantGlobal" flag is true, 

time allocated to drivers in the computer system of the then "SendMouse" examines the coordinates of the 

preferred embodiment. These functions may include, mouse relative to specified GRAFPORTS in the system 

among other things, emulating a mouse movement, which define windows on the display of the target 

typing text, or determining the state of user interface 5 Therefore, if the "WantGlobal" Hag is false, and the 

objects, or the operating condition of the target. These cursor position is within the bounds of given window 

functions are performed when the host processor issues defined by a grafport, then the position returned to the 

certain basic commands which can be performed by the host machine is relative to the grafport in which the 

target machine. cursor is found. 

The agent program in the target machine is con- 10 PutMouse 
trolled by actors in the host machine. Actors may issue This routine moves the cursor mouse position to the 
commands to the agent program in the target in order to position specified. This routine has the following pa- 
cause the target perform certain actions. These include rameters: 

returning information about the target or causing the TargetMouse — A pointer to a datum describing the 

target to perform a certain action. Commands that 15 desired position and button state of the mouse, 

cause a target to return information return the informa- ReturnSizeP— Size of the returned value generated 

tion as an abstraction or representation of the object(s). by this procedure. 

In other words, screen bitmaps of graphical user inter- moleVars— This is a data structure set up by the 

face objects used in target machines of the preferred agent which maintains, among other things, the file 

embodiment are not returned, but instead, positions, 20 descriptor of the "uinter" (user interface) driver for 

titles, highlighted states, etc. (as discussed with refer- the AUX (the Apple brand version of the UNIX 

ence to descriptors above) may be returned instead of operating system) operating system, 

the bitmap representation itself. Commands issued to The 'TargetMouse" variable points to a structure 

the targets by actors in the host include the following: containing the x and y values of the new mouse position. 

SendMouse 25 In addition, the structure contains a boolean value indi- 

This routine returns the current position of the cursor eating the desired button state after the mouse has been 
on a display screen of the target. It returns the current moved to its position. The value is a one-bit value con- 
position as two integer values in the response transmit- taining a one or "true" value if the button is desired to 
ted over network 110. The host processor knows that be depressed, and it contains "false" or zero if it desired 
the next response from the target machine containing 30 to be released. Any previous states of the mouse are 
the socket number of the agent program in the target modified to the current values. These are performed by 
will contain the x and y values of the cursor position. As modifying the global variables RAWMOUSE, 
mentioned with regards to the screen display and cursor MTEMP, and MOUSE, MB STATE, and MBTICKS 
script commands, the value is given as the x coordinate in the low memory area of the target machine. In addi- 
preceded by the y coordinate. The coordinate may be 35 tion, the variable CRSRNEW is modified indicating 
either an absolute (global) or local coordinate (relative that the cursor position needs to be updated on the next 
to a window on the screen) if certain parameters are interrupt during the display's vertical blanking interval 
specified. The parameters issued via the "SendMouse" of the target machine. This routine will pass an error 
command are as follows: condition to the host processor if the cursor position 
WantGlobal 40 attempted was outside the range of the currently de- 

This is a boolean value indicating that global coordi- fined screen limits, 
nates are desired. If this value evaluates to "false," then Using the routine "PutMouse," the preferred embodi- 
coordinates relative to a current window (called "local ment allows mouse movements and selections finclud- 
coordinates") are returned. Otherwise, the absolute ing selection of pull-down menus and other user inter- 
screen location of the cursor is returned. 45 face objects) to be emulated on the target machine. One 
TargetMouse such movement function directed by the host to be 

This is the pointer to the x and y values returned by emulated by the target computer is shown in a flow 

the agent program in the target to the actor program in diagram shown in FIG. 8. Step 802 determines whether 

the host the position of the mouse is a relative movement or an 

ReturnSizeP 50 absolute movement according to the "r:" or "a;" op- 

This is the size of the return value(s) generated by this tions specified in the "Select" command. If it is a rela- 

routine. The host may examine this value to determine tive movement, then steps 803 and 804 are executed in 

how much of the datum residing at position Target- order to determine the current mouse position of the 

Mouse must be read. target machine's cursor using the routine "Send- 

The "SendMouse" routine is a function call, so that a 55 Mouse© " Then, using the new position specified in the 

return of a non-zero value indicates that the send mouse "Move" command in the script, and the old position 

command failed. In this case, an error code is returned, retrieved from the target machine, a new position is 

which is decoded according to certain constants defini- calculated at step 804 by summing the relative position 

tions defined for the host routine, with the absolute position retained in the low memory 

"SendMouse" operates by examining certain global 60 data structures of the target machine, 

variables contained within the low memory region of If it was not a relative movement, as determined at 

the target computer. These low memory global van- step 802, or step 804 is complete, process 800 proceeds 

ables are maintained by the Macintosh brand operating to step 805 wherein the routine "PutMouseO" is issued 

system. For example, the cursor position information to move the mouse to the absolute position specified by 

can be obtained from the global variable MOUSE. The 65 the actor in the host Then, using the variables specified 

state of the mouse button (up or down) is obtained from in the call to "PutMouseQ," at step 806, the target up- 

the global variable MB STATE, which evaluates to dates the variables contained within the low level mem- 

either "true" or "false." In order to generate local infor- ory locations) such as "RAWMOUSE," "MTEMP," 
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and "MOUSE" at step 806 to emulate user movement of These are more discussed in more detail in the publica- 
the mouse. Upon the next display update in the target tion, "Inside Macintosh, Volume V" at pages V-367 
machine, as shown in step 807, the mouse position is through V-373. A pointer is passed to the target ma- 
actually moved on the target machine's display. This chine which references the area of memory containing 
may be confirmed in a subsequent operation if the host 5 the strings which have the keystroke sought to be emu- 
issues a "SendMouseO" command to the target. Process lated on the target machine. The string which is pointed 
800 then ends at step 808. to by the parameter value is a standard string wherein 
Mouse down and mouse up operations indicated by the first byte contains a length value, and the next byte 
operations such as "Click," "Doubleclick," "Press- contains a key code whose first bit reflects whether the 
Mouse," and "ReleaseMouse" in the preferred embodi- 10 key is up (a one) or down (a zero). Depending on the 
ment are handled by posting events to event managers length value, subsequent bytes can contain key codes as 
contained within the Apple Macintosh brand operating well Multiple keystrokes are entered by calling Enter- 
system. These are done by calling operating system KeystrokeO multiple times. 

routines such as- the function "PostEvent" which adds A number of other commands are provided in order 
an event such as a mouse up/mouse down action which 15 for the host to direct the target machine to perform a 

gets posted to the event queue of the operating system. specified action. Although a description of the parame- 

The operating system event manager is found and dis- ters of the following actions wfll not be described, a 

cussed in more detail in the publication "Inside Macin- summary of these commands will be set forth in order 

tosh, Volume IV" (1986) at page IV-85. Mouse down to provide a complete understanding of the features 
and mouse up operations are indicated to the target to 20 provided by the preferred embodiment in order to cause 

be performed by a boolean pointed to by TargetMouse. the target to perform actions directed by the host 

PutMouseString These commands are as follows: 

This routine receives a pointer to an array of "Put- SendStatus 
MouseQ" parameter blocks and a parameter for return- This provides the host with the means of identifying 
ing error codes. It calls the routine "PutMouse" as a 25 potential targets attached to the network and confirm- 
series of positions and button states to perform gestures ing the existence of an already active agent program 
like double clicking which need to be performed within running in target machines. Each of the agents residing 
a certain time threshold. It modifies a system variable in target machines returns status information about the 
entitled TICKS which resides in the low memory area agent in the system on which it is running. The host may 
of the memory of the target computer in order to emu- 30 then build a structure to maintain communication be- 
late the double clicking action by a emulated user. This tween all the target machines coupled to network 110. 
is done, in the manner described above, using "Put- SendBlock 

Mouse" to posts events to an event queue for processing This routine causes the target machine to send up to 

by the event manager. This error routine returns an 512 bytes from the target machine's memory, 

error code if it is not successful, and it returns a "sue- 35 SyncSendBlock 

cessful" if the routine successfully completes the perfor- This is the same as the SendBlock command, how- 

mance of the operation. ever, it is executed at system task time rather than net- 

EnterKeystroke work interrupt time when normal commands are exe- 

The parameters of this routine include: cuted. This allows synchronization with events occur- 

keyCode— The character to be entered on the key- 40 ring in the target machine to make sure that the values 

board. contained in those locations are valid. 

outBufTP— Currently unused. SendHBlock 

returnSizeP— Size of the return value returned by This also sends up to 512 bytes from the target sys- 

this routine. tern's memory. As opposed to SendBlock and Sync- 

moleVars— This is a pointer to the global variable 45 SendBlock which access memory through a pointer, it 

parameters to the accesses the memory through a handle (a pointer to a 

EnterKeystrokeO routine. task). 

The following variables are contained within the area SendMenulnfo 

pointed to the by the moleVars variable above: This loads the return buffer with information about 

ADB_LENGTH — This is a length variable for the 50 the menu having a particular rank. The rank is deter- 

string passed to the keyboard driver in the target mined by the matcher. 

machine. SendMenuItem 

ADB1— This is first keyboard key code for the target This routine causes the agent process in the target to 

machine. seek out the menu containing the attributes as specified 

ADB2 — This is the second key code, if there is any. 55 in the SendMenulnfo command, and return the mark 

V— KEY — This is the virtual key code for Macintosh character, icon, and command key equivalents for the 

Plus brand computer systems. menu items. A menu hern is identified by rank deter- 

ASCI I . KE Y — This is not used in later versions of mined by the marcher. 

the the Macintosh brand target computer systems. SendFindWindow 

DOWN—S ri KOKE— Used for Macintosh Plus brand 60 This routine returns information about the window 

computer systems and is a boolean value contain- currently under a point specified in global coordinates. 

ing true if the key is being depressed. It is false if If there are no windows under the cursor or the win- 

the key is being released. dow belongs to a background task, then information 
The "EnterKeystroke" routine is used to call the about the front-most window is returned by default. If 
standard keyboard driver of the target computer system 65 the point is over a window that belongs to the fore- 
such that keyup and kcydown states by a user are emu- ground (active) task but is not an active window, then 
lated on the target. Keystrokes are fed to the target information is returned about that window. This routine 
using the Apple Desktop Bus brand manager routines. calls the Macintosh's window manager program "Find- 
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Window" to determine attributes of the window sped- forming operations on the target, or commands seeking 
Med by rank. The rank is determined by the matcher. state information about the target are contemplated 
SendWindowInfo within the spirit and scope of the present invention. 

The target machines scans through all the windows in These examples are set for illustration purposes only, 
the memory in the target and returns the information 5 and should not be viewed as limiting the present inven- 
about the window having the rank specified. tion. 

SendControilnfo Commands that are used to determine the current 

This command returns information about the speci- state of the target machine, causes the target to access 
tied control from the target machine. The control is data structures contained within the target and return 
specified by the rank of the window owning the control 10 the values of requested items in these structures in a 
and the control rank within the window. These are predefined format understood by the actor thread in the 
specified in the data structures of the target machine, as host These values are returned to the host and pointed 
discu^ed above. to by the parameter list pointer "moleVars." For in- 

SendFindDItem stance, in order for the host to determine the status of a 

This command returns information about a dialog 15 window with a specified title, the data structures con- 
item which is under a specific point in global coordi- taming window description information are scanned by 
nates. Global coordinates are passed to the agent in the the matcher using rank through a series of SendFind- 
target machine, and the command determines whether WindowO commands until a window with the highest 
there is a window under those coordinates. If that sue- total matching value is determined. Then, this window 
ceeds, and the window is a dialog window, then it de- 20 is referenced by rank. Examples of data structures used 
termines the position of the dialog item under the speci- in target machines such as the Apple Macintosh brand 
c JS mt " t r operating system are found in the publication "Inside 

SendDItemlnfo Macintosh,, Volume I" at pages 1-269 through 1-308. 

This command sends back information about a dialog Then, the attributes of the window may be returned to 
item which is speafied by the host The item is specified 25 the host using the moleVars pointer returned in re- 
by a window rank and an item rank number. The infor- sponse to the SendFindWindowO command for the 
mation returned includes the type of item, whether the rank specified. A detailed description of the data struc- 
rtem has text associated with it, etc. ture used for windows displayed on target machines in 

SendNextEvent the Apple Macintosh brand operating system is shown 

This routine returns the record of the next pending 30 in the publication "Inside Macintosh, Volume I" at page 
event in the event queue of the target machine. These 1-276. The renaaining system state information corn- 
may include, among other things, keyboard and/or mands such as determining menu information, deter- 
mouse movement information. This program emulates mining menu items, determining the current active win- 
the routine GetNextEventO which is used for servicing dow, among others, may be performed in a similar man- 
events m Macintosh brand operating system programs. 35 ner when the agent process in the target machine scans 
This program returns a record known as a "event re- other data structures similar to that of the window re- 
cord" which tells the host machine the current pending cord data type shown in the publication "Inside Macin- 
action in the target machine, This may be used to syn- tosh, Volume I" at page 1-276. For instance, the con- 
chronize operations between host and target machines trols for windows may be referenced as is set forth in 
and is typically used in the preferred embodiment to 40 the pubheation 'Inside Macintosh, Volume r at pages 
determine if simulated input events have been processed 1-311 through 1-334, or "Inside Macintosh, Volume V" 
to avoid issuing new events to the Event Manager. at pages V-225 to V-258. 

SendResPeek More complex functions such as selecting windows, 

This routine returns the. resource data for a "rc- selecting menus, closing windows, resizing, scrolling, 
source" having a specified type and identification value. 45 etc. as is set forth in the scripting language above may 
Resources are items used in the preferred embodiment be performed by ascertaining the current position of the 
Macintosh brand operating system for defining various object (or control) to be moved on the display of the 
objects such as menus, windows, etc. These are dis- target machine using the appropriate command (such as 
cussed m more detail in the publications "Inside Macin- SendMouseO, SendFindControO, SendFindWindowO 
tosh, Volume I," at pages 1-103 through 1-132, "Inside 50 etc.), and then issuing basic commands to cause the 
Macintosh, Volume IV," at pages IV- 15 through IV-21, desired action. For instance, with reference to FIG 9 a 
and 'Inside Macintosh, Volume V," at pages V-29 "Resize Window" instruction specified in the script 
through V-37. The resource information is passed back language of the preferred embodiment, process 800 may 
up to the maximum length of the packet transfer buffer, be performed. 

which is approximately 512 bytes in length. 55 For instance, as shown in FIG. 9, the matcher deter- 

SendlconHeight mines the appropriate window to control by issuing 

This routine returns the height of the icon in pixels SendFindWindowO instructions multiple times until the 
specified by an icon resource ID. correct window with the highest total trait weight is 

SendScnptlnfo ascertained at step 902. Once determined, the matcher 

This sends the system, application, and keyboard 60 again determines the position of the resize gadget at step 
script currently running on the target machine. 903. This may be done by assuming that the resize gad- 

SendCurrKCHRid get resides at the lower fight hand position of the win- 

This routine returns the KCHR (keyboard mapping dow. This will determine the position of the resize gad- 
table) ID. which is currently in use on the target ma- get 1001 of a window such as 1000 shown in FIG. 10. 
chin f • 65 Once the resize gadget has been determined, it again is 

Although the foregoing is a brief description of the tetermined at step 904 whether this is a relative move- 
current commands available by the host to execute on ment or not. If it is a relative movement, then the new 
the target, h is contemplated that other commands per- position of the window resize box will be calculated at 
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step 904 using the control position determined at step 
903. If not, step 904 proceeds to 906. 906 will move the 
cursor such as 1010 shown in FIG. 10 to the position of 
the resize box such as 1001 shown in FIG. 10 using the 
PutMouseQ command discussed above. At step 907, the 
resize control 1001 is selected using PutMouseO. While 
the mouse key continues to be depressed, as indicated 
by the PutMouseO command, the cursor 1010 is caused 
to move to the new position 1002 using PutMouseO, at 
step 908. In the example shown in FIG. 10, the mouse 
has been moved by an x value of 35 and a y value of 25. 
Once at the new position 1002, the mouse button is 
released at step 909 using the PutMouseO command, 
and process 900* ends at step 910. Thus, window 1000 
has now been resized to a new size 1020 shown in FIG. 
10, such that its resize control resides at the new posi- 
tion 1002 shown in FIG. 10. 

It can be appreciated by one skilled in the an using a 
combination of "Send" commands which determine the 
status of the target machine and "Put" commands for 
either moving the mouse or "Enter** commands for 
entering text into the window of the target machine, 
that virtually any user input functions may be emulated 
on a target machine using a combination of keystroke 
entry commands and mouse movement commands. The 
determination of whether the command was successful 
or not can be ascertained by issuing the appropriate 
**Send'* command(s) at the termination of the operation 
in order to determine the state of windows, menus, 
mouse positions, or other information retained on the 
display of the target system. 
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selectors for each of the commands and are as set forth 
below: . 
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Maintaining Communication Between the Host and 
Target Systems 

Communication is provided between the host and 
target machines using a transaction processing protocol 
known as ATP (the Appletalk Transaction Protocol 
brand protocol). Although a detailed discussion of the 
transaction protocol of the preferred embodiment will 40 
not be set forth here, it can be appreciated by one skilled 
in the art that using this protocol (see "Inside Appletalk, 
Second Edition," at pages 9-1 through 9-28), that calls 
can be made to routines (such as SendMouseO, Put- 
MouseO, etc.) in the target machine, and responses to 45 
queries may be made back to the host machine. Specifi- , 
cally, the actor in the host machine, and the agent in the 
target machine, establish communication via a "socket** 
for passing messages. Communication is provided using 
the routine "PNSendResponse" specified in the above 50 
reference. Contained in each call between the agent and 
host process is an opcode for the desired command, and 
a pointer pointing to the parameter data or the result 
data passed between the two machines. In addition, a 
pointer is provided to an error number, and if the func- 55 
tion fails, an error number greater than zero is returned 
to the actor controlling the target The parameter block 
transferred using ATP in the preferred embodiment 
contains the following data: 
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userData 



bd£Pomter[0].dataSize 

txJsPoinicr[0].bufTPtr 

bdsPointer[OJ.u«rBytes 

ioResultf 



The command selector or opcode (2 
bytes) followed by the result code 
(2 bytes) 

The size of the response data 
Pointer to the response data 
The command selector (2 bytes) follow- 
ed by the result code (2 bytes) 
ATP result of the request call 
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Command Name 


Decode 


AbortPendingCmd 


— I 


SendStatus 


0 


GoOffLine 


1 


ComeOnLine 


2 


SendBlock 


3 


SendBlockSizc 


5 


SendMouse 


6 


PutMouse 


7 


EnterKeystroke 


8 


SendMenuInfb 


9 


SendMenul terns 


10 


SendFrontWindow 


12 


SendFindWindow 


13 


SendWindowlnfo 


14 


SendFtndConiro] 


15 


SendControHnfo 


16 


SendFindDItem 


17 


SendDItemlnfo 


18 


SendResPeek 


19 


SyncSendBlock 


20 


SendNextEvent 


21 


SendHBlock 


22 


PutMouseString 


23 


SendlconHeight 


24 


SendScriptlnfo 


25 


SendCurrKCHRid 


26 



Once the target machine decodes the command selec- 
3 Q tor embedded in the variable "userData," the command 
opcode or command selector is used to decode the 
remaining parameter data contained within the buffer 
area pointed to by bdsPointer[0].buffPtr. 



Session Commands 

The host processor provides communication with the 
target system via a special series of commands used with 
ATP and as specified by the preferred embodiment 
The three commands are: 

ComeOnLine; 

GoOffLine; and 

AbortPendingCmd. 

ComeOnLine is a command issued by the host to the 
target to execute the low level procedure originating 
from the host machine. This is graphically shown in 
FIG. 11. At initialization time, the code to the agent 
driving routine is started at 1101, and the Appletalk 
protocol "GetRequest" will be initialized at step 1102. 
The process then waits at step 1103 for the client rou- 
tine (the actor for the target) to issue a "send" request at 
step 1103. If the process is desired to be processed now 
as determined by the priority in the ATP protocol de- 
termined at step 1104, then the command is processed at 
step 1108, any responses are sent back to the client at 
step 1109, and the Appletalk protocol is posted with the 
next "GetRequest" at step 1110. Then, the next "Sen- 
dRequest" is waited for at step 1103. If, however, the 
command cannot be processed now as determined at 
step 1104 (depending on the type of command), com- 
mand execution is deferred until system task time at step 
1105, and the command is processed at step 1106 with a 
response being sent at step 1107. Some commands are 
always executed at network interrupt time while other 
commands are always executed at driver time. This is to 
ensure that data in the target is in a determinant state 
(eg. it is not in the process of being modified). The 
proceeding routine is executed by the agent process 
wherein it receives a request from the host to **Come- 
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OnLine" by issuing that command via a "Send" request the target computer system to cause the target com- 

from the client process in the host computer. Once the puter system to respond as if a user had entered input 

agent has come "on line," it is listening for any com- through a numeric keypad. 

mands to be sent to the agent's socket number, and the 4. The system of claim 2 wherein the at least one 
command received from the host is thereby executed. 5 keyboard input emulation instruction includes a press- 
Once executed, the agent will stay listening on the net- key instruction and a release-key instruction, said host 
work for messages to be sent to its socket number, until computer system interpreting the press-key instruction 
a "GoOffLine" command is issued by the actor in the to cause the host computer system to issue the first 
host Because an agent may only listen to one client series of commands to the target computer system to 
process at a time, once a "ComeOnLine" command is 10 cause the target computer system to respond as if a user 
issued to an agent process residing in the target ma- had pressed a designated key, said host computer sys- 
chine, it may receive messages from no other hosts on tem interpreting the release-key instruction causing the 
the network (this is true for all command except "Send- host computer system to issue the first series of corn- 
Status" which the target will respond to if issued by any mands to the target computer system to cause the target 

15 computer system to respond as if a user had released the 

Thus an invention for remote testing and diagnosis of designated key. 
computer systems has been described. Although this has 5. The testing system of claim 1 wherein the display 
been described particularly with reference to FIGS. 1 includes a cursor having a status, the second set of in- 
through 11 and the specific embodiments thereof, it is structions including at least one cursor status command, 
contemplated that many changes and/or modifications 20 said host computer system interpreting the at least one 
may be made by someone skilled in the an and remain cursor status command causing the host computer sys- 
within the present spirit and scope of the present inven- tem to issue the second series of commands to the target 
fa0 JL ... computer system to cause the target computer system to 

What is claimed is: transmit data indicative of the status of the cursor to the 

1. A testing system for testing a target computer 25 target computer system. 

system, the target computer system having a display for 6. The testing system of claim 5 wherein the at least 

displaying a plurality of user interface objects, the plu- one cursor status command includes a send mouse com- 

rality of user interface objects having a plurality of mand, execution of the send mouse command causing 

states, the testing system comprising: the host computer system to issue the second series of 

a host computer system coupled to said target com- 30 commands to the target computer system to cause the 

puter system, said host computer system interpret- target computer system to transmit data indicative of a 

ing a sequence of instructions to test said target position of the cursor. 

computer system, the sequence of instructions con- 7. The testing system of claim 6 wherein the position 

taming a plurality of instructions from a predefined is a designated position of either the position of the 

language, the predefined language including a first 35 cursor relative to the entire display, or the position of 

set of instructions and a second set of instructions; the cursor relative to a designated portion of the dis- 

said host computer system interpreting instructions play, 
from the first set of instructions to cause the host 8. The testing system of claim 1 wherein the first set 
computer system to issue a first series of commands of instructions includes at least one mouse input emula- 
te said target computer system; 40 tion instruction, said host computer system interpreting 

said target computer system emulating user activity the at least one mouse input emulation instruction caus- 
on said target computer system responsive to said ing the host computer system to issue the first series of 
first series of commands, wherein at least one state commands to the target computer system to cause the 
of said plurality of states is changed responsive to target computer system to respond as if a user had en- 
said target computer system emulating user activ- 45 tered mouse input on the target computer system. 
}ty'> t 9. The testing system of claim 8 wherein the at least 

said host computer system interpreting instructions one mouse input emulation instruction includes a mouse 

from the second set of instructions to cause the host move instruction, a mouse click instruction, a mouse 

computer system to issue a second series of com- double click instruction, a press mouse instruction and a 

mands to the target computer system; 50 release mouse instruction, execution of the mouse move 

said target computer system transmitting to the host instruction causing the host computer system to issue 

computer system data indicative of the state of a the first series of commands to the target computer 

specified user interface object of said plurality of system to cause the target computer system to respond, 

user interface objects responsive to the second as if a user had moved a mouse connected to the target 

series of commands. 55 computer system, execution of the mouse click instruc- 

2. The testing system of claim 1 wherein the first set tion causing the host computer system to issue the first 
of instructions includes at least one keyboard input series of commands to the target computer system to 
emulation instruction, said host computer system inter- cause the target computer system to respond as if a user 
preting the at least one keyboard input emulation in- had clicked the mouse connected to the target computer 
struction to cause the host computer system to issue the 60 system, execution of the mouse double click instruction 
first series of commands to the target computer system causing the host computer system to issue the first series 
to cause the target computer system to respond as if a of commands to the target computer system to cause the 
user had entered keyboard input on the target computer target computer system to respond as if a user had dou- 
system. ble clicked the mouse connected to the target computer 

3. The testing system of claim 2 wherein the at least 65 system, execution of the press mouse instruction causing 
one keyboard input emulation instruction includes a the host computer system to issue the first series of 
numeric keypad input instruction for causing the host commands to the target computer system to cause the * 
computer system to issue me first series of commands to target computer system to respond as if a user had 
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pressed a button on the mouse connected to the target 
computer system, execution of the release mouse in- 
struction causing the host computer system to issue the 
first series of commands to the target computer system 
to cause the target computer system to respond as if a 
user had released the button of the mouse connected to 
the target computer system. 

10. The testing system of claim 1 wherein the display 
of the target computer system includes a window, the 



40 



14. The testing system of claim 1 wherein the display 
of the target computer system includes a menu, the first 
set of instructions including a menu select instruction, 
execution of the menu select instruction causing the 
host computer system to issue the first series of com- 
mands to the target computer system to cause the target 
computer system to respond as if a user had selected a 
designated menu item on the menu. 

15. The testing system of claim 1 wherein the first 



first set of instructions including at least one window 10 seri ^ of commands cause the target computer system to 



15 



manipulation instruction, said host computer system 
interpreting the at least one window manipulation in- 
struction causing the host computer system to issue the 
first series of commands to the target computer system 
to cause the target computer system to respond as if a 
user had manipulated the window. ■ 

11. The testing system of claim 10 wherein the win- 
dow has a size, the at least one window manipulation 
instruction including a select window instruction for 2 o 
causing the second computer to respond as if a user had 
selected the window, a drag window instruction for 
causing the second computer to respond as if a user had 
dragged the window, a size window instruction for 
causing the second computer to respond as if a user had 25 
altered the size of the window, a close window instruc- 
tion for causing the second computer to respond as if a 
user had closed the window, and a zoom instruction for 
causing the second computer to respond as if a user had 
zoomed the window. 30 

12. The testing system of claim 1 further comprising: 
a second target computer system coupled to the host 

computer system, the second target computer sys- 
tem including a second display for displaying a 
second plurality of user interface objects, the sec- 35 
ond plurality of user interface objects having a 
second plurality of states; 
said host computer system directing a first thread to 
cause the target computer system to perform re- 
sponsive to said sequence of instructions and a 
second thread to cause the second target computer 
system to perform according to a second sequence 
of instructions independent of the first target com- 
puter system, 
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emulate user activity on the target computer system by 
causing an event indicative of the user activity to be 
posted in an event queue of an event manager in the 
target computer system. 

16. In a first computer system, a method of testing a 
second: computer system, wherein the first computer 
system is coupled to the second computer system, the 
method comprising the steps of: 

a) interpreting a first sequence of instructions, the 
first sequence of instructions directing emulated 
user activity on the second computer system; 

b) issuing a first plurality of commands to the second 
computer system, the first plurality of commands 
directing the second computer system to emulate 
the emulated user activity; 

c) interpreting a second sequence of instructions, the 
second computer system having a display for dis- 
playing a plurality of user interface objects, the 
plurality of user interface objects having a plurality 
of states, the second sequence of instructions re- 
questing state data indicative of the plurality of 
states; 

d) issuing a second plurality of commands to the 
second computer system, the second plurality of 
commands requesting state data indicative of the 
plurality of states, the second computer system 
transmitting the state data to the first computer 
system responsive to the second plurality of com- 
mands; and 

e) receiving the state data from the second computer 
system, the state data containing a plurality of ab- 
stractions of the plurality of user interface objects 
on the display of the second computer system. 

17. The method of claim 16 wherein the first se- 



the sequence of instructions causing said target com- 45 ? uence of instructions includes at least one keyboard 

puter system to emulate user activity and causing ™ put e^ 1 "" 1 instruction, said host computer system 

the target computer system to report the plurality lnterpretm S at Ieast one keyboard input emulation 

of states to the host computer system- instruction to cause the host computer system to issue 

the second sequence of instructions causing the sec- < n ™ P lun * tv u <* commands to the target computer 

ond target computer system to emulate user activ- 50 ^ "!Th nt^'t^T to / es P ond 

as it a user had entered keyboard input on the target 
computer system. 



lty and causing the second computer system to 
report the second plurality of states to the host 
computer system. 
13. The testing system of claim 1 wherein said host 55 
computer system causes the target computer system to 
perform a plurality of specified actions according to one 
or more commands contained said predefined language, 
wherein the predefined language comprises a set of 



18. The testing system of claim 16 wherein the first 
sequence of instructions includes at least one mouse 
input emulation instruction, said host computer system 
interpreting the at least one mouse input emulation 
instruction causing the host computer system to issue 
the first plurality of commands to the target computer 
system to cause the target computer system to respond 



descriptors which define a plurality of abstractions, the 60 as if a user had entered mouse input on the tareet com- 



plurality of abstractions being descriptive of said plural- 
ity of user interface objects. 



puter system. 
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